AI-Powered BIM Based AR Application for Construction

Ch. Lakshmi Naga Lasya

, Mouli Kumar Kasireddy

, G. Navdeep Varma

and Malathi Janapati

Velagapudi Ramakrishna Siddhartha Engineering College, Kanuru, Vijaywada, India

Dept. of Artiﬁcial Intelligence and Data Science, Velagapudi Ramakrishna Siddhartha Engineering College,Vijayawada,

India

Keywords:

Augmented Reality, Building Information Modeling, Artiﬁcial Intelligence, Revit, Unity, Vuforia.

Abstract:

Augmented Reality (AR) in Construction overlays digital information onto real-world environment with

precision. Building Information Modeling (BIM) integrates comprehensive 3D models and data into the

construction process. While construction ﬁrms are updated using BIM and CAD software to create detailed

3D model Not only that errors prohibited during the building plan design phase because the construction of

something is intended to last for generations, but it could also be difﬁcult to identify those errors without close

inspection.Misalignment between the design and actual on-site implementation is one of the primary drivers

of delays.The proposed project aims to develop an AR and BIM-based Android application that overlays 3D

models onto 2D construction plans. Therefore, the proposed scheme is divided into four phases. In the ﬁrst

phase we use Autodesk forma is a cloud-based design tool tailored for architects for early-stage building and

site analysis. It uses AI to optimize designs for environmental factors, offering real-time feedback. Second

step is to create 3D model for ﬂoor plan using BIM software Revit. In the third phase, we use AR software

development kit Vuforia to overlay digital content on real-world environment. Last step is using Android SDK

Tools for testing on an Android Device.

1 INTRODUCTION

The construction industry is increasingly using ad-

vanced digital technologies like Building Informa-

tion Modelling (BIM) and Augmented Reality (AR)

to enhance project in different terms. BIM facili-

tates the use of 3D models and detailed data to im-

prove collaboration, accuracy, and decision-making

across various stages of construction projects. Even

though, there remain challenges in translating digi-

tal designs into physical construction Often, misin-

terpretation of traditional 2D drawings or even tradi-

tional 3D BIM models results in inconsistency dur-

ing construction, leading to delays, cost overruns, and

the need for rework (Kwon, Arau, et al. 2014). This

tells the importance of improving the precision and

efﬁciency of construction inspection and planning.

The integration of AR and BIM presents a power-

ful solution to these challenges. AR overlays digital

models onto physical environments, offering a real-

time, interactive interface that allows users to explore

and analyze construction elements directly on-site or

through 2D plans, which improves the detection of

inconsistencies and enhances construction manage-

ment (El Ammari and Hammad, 2019). By com-

bining BIM’s detailed design models with AR’s im-

mersive visualization, it becomes easier to catch de-

sign errors before they lead to costly rework (Chen,

Abbas, et al. 2020).Recently, researchers have ex-

plored the integration of artiﬁcial intelligence (AI)

into AR-BIM applications to further enhance the con-

struction process. AI- driven tools optimize design

performance by analyzing environmental factors such

as sunlight and wind patterns, helping architects and

engineers make informed design decisions early in

the project (Nguyen and Tran, 2021).This research in-

troduces an AI-powered BIM and AR-based Android

application designed to improve construction plan-

ning and inspection by overlaying 3D models onto 2D

construction plans. The proposed application lever-

ages AI for optimizing early-stage designs and uti-

lizes AR for real-time visualization and error detec-

tion. This solution aims to minimize errors, reduce

rework, and enhance overall project efﬁciency, con-

tributing to more accurate project execution and cost

management (Riaz and Kaleem, 2021).

400

Lakshmi Naga Lasya, C., Kumar Kasireddy, M., Navdeep Varma, G. and Janapati, M.

AI-Powered BIM Based AR Application for Construction.

DOI: 10.5220/0013618800004664

Paper published under CC license (CC BY-NC-ND 4.0)

In Proceedings of the 3rd International Conference on Futuristic Technology (INCOFT 2025) - Volume 3, pages 400-405

ISBN: 978-989-758-763-4

1.1 Motivation

It is difﬁcult to ensure that designs are accurately im-

plemented on-site is critical to avoid costly mistakes

and delays. Even with modern tools like BIM, there

are still challenges when it comes to translating these

designs into real-world construction. Errors often oc-

cur because workers have to interpret complex 2D

plans or even traditional 3D models, which can be

difﬁcult and time-consuming.This research aims Inte-

grating Augmented Reality (AR) with BIM allows for

real-time visualization of digital models in the physi-

cal environment, making it easier to identify potential

issues early. By developing an Augmented Reality

(AR) application that overlays 3D BIM models onto

2D construction plans, this project aims to reduce er-

rors, save time, and improve collaboration, ultimately

leading to better project outcomes.

1.2 Problem Statement

The construction industry frequently encounters difﬁ-

culties in accurately transforming digital designs into

physical structures, resulting in misunderstandings of

Building Information Modeling (BIM) and traditional

2D drawings. These misunderstandings often lead

to signiﬁcant errors, costly rework, and project de-

lays. Existing approaches do not sufﬁciently incor-

porate Augmented Reality (AR) and artiﬁcial intelli-

gence (AI), limiting the effectiveness of design visu-

alization and the early detection of discrepancies dur-

ing construction. Thus, there is a need for a solution

that integrates AR, BIM, and AI to improve efﬁciency

in construction planning and inspection.

1.3 Objective

The integration of Building Information Modeling

(BIM)with Augmented Reality (AR) enables users to

see three-dimensional building designs overlaid on

real-world environments, making the project more

immersive and engaging AR technology allows ﬁeld

workers to better understand and communicate design

information, makes possible for discussions about po-

tential conﬂicts and enabling the team to collabora-

tively make informed decisions Our approach stream-

lines the construction process by minimizing errors

and providing real-time information, ultimately en-

hancing overall project effectiveness.

2 LITERATURE REVIEW

Cheng, Riaz, and Kaleem (2021)(Cheng, Riaz, et al.

2021) explored the beneﬁts of AR, BIM, and AI inte-

gration in improving overall construction workﬂows,

highlighting signiﬁcant gains in efﬁciency and ac-

curacy on-site, with a focus on enhanced decision-

making through real-time data visualization and au-

tomation tools. Grau and Hartmann (2019)(Grau and

Hartmann, 2019)further emphasized the role of AR

and BIM integration in reﬁning construction planning

and facilitating collaboration among project stake-

holders. Their study indicated that using AR for

visualizing BIM models improved stakeholder com-

munication and reduced planning errors. The appli-

cation of AR combined with BIM for on-site man-

agement was investigated by Kirschen and Sonnen-

tag (2018)(Kirschen and Sonnentag, 2018), who il-

lustrated how AR-assisted BIM models could support

site managers in monitoring and managing construc-

tion activities, ultimately reducing project delays and

enhancing safety compliance. Hammad and Zhang

(2019)(Hammad and Zhang, 2019)also examined AR

and BIM synergy, noting that the integration pro-

motes better collaboration between remote teams and

on- site personnel by offering real-time model up-

dates and interactive project reviews. Cheng, Yuan,

and Wang (2021)(Cheng, Yuan, et al. 2021) intro-

duced AI and AR for real-time BIM-based construc-

tion planning, proposing that this integration enables

adaptive planning and improves project scheduling

accuracy. The use of AI in AR applications for con-

struction was further analyzed by Chen, Lai, and Lin

(2020)(Chen, Lai, et al. 2020), who discussed how

AI-driven AR can optimize BIM processes by en-

abling predictive modeling and on-site risk identiﬁca-

tion, thereby enhancing overall project performance.

Abbas and Marino (2020)(Abbas and Marino, 2020)

presented a case for AI-powered AR in facilitating

BIM-based construction site inspections.

3 ARCHITECTURE

3.1 Site Analysis and Initial Planning

Data Collection: Gather detailed information about

the construction site, including topography, existing

structures, and environmental conditions like sun-

light,temperature and wind efﬁciency etc.

Preliminary Design: Utilize the collected data to cre-

ate initial building designs, ensuring they align with

site constraints and regulatory requirements.

AI-Powered BIM Based AR Application for Construction

401

Figure 1: workﬂow of integration of augmented reality with

Building Information Modeling.

3.2 Design and Develop BIM Model

Following the site analysis, a Building Information

Model (BIM) is created. The BIM model includes

detailed structural, architectural, mechanical, electri-

cal and plumbing information, serving as a 3D repre-

sentation of the building. This is typically developed

using software like Autodesk Revit. The model then

goes through a review and correction phase. If there

are any errors, they are corrected at this stage before

moving on to the next step, ensuring the model is ac-

curate and ready for use.

3.3 Export BIM Model as .fbx File

After ﬁnalizing the BIM model, it is exported as an

.fbx ﬁle, which is a common format used for 3D mod-

els and compatible with visualization platforms. This

export is necessary to integrate the BIM model with

the augmented reality software.

3.4 Vuforia Database

In this architecture, Vuforia is an augmented reality

(AR) software development kit that enables the recog-

nition of image targets, such as 2D construction plans,

and overlays 3D BIM models onto them, allowing for

visualization in real- world environments. It acts as

the core AR engine for aligning digital content with

physical environment.

3.5 Unity Application

The next step is to use Unity, a game development

engine, to build the Augmented Reality (AR) view.

The 3D BIM model exported earlier is integrated into

Unity, where the Vuforia SDK helps with recogniz-

ing image targets and rendering the augmented reality

overlay.Once the AR functionality is built in Unity, it

is ready for deployment.

3.6 Android Application

The AR application is then packaged as an Android

app using the Android development tools.The app is

prepared for use on Android devices, where the 3D

BIM model can be viewed in augmented reality. Once

the testing is completed and all issues are resolved,

the application is ﬁnalized. This ensures that the 3D

BIM models are accurately displayed on top of 2D

plans, providing enhanced visualization and collabo-

ration for construction teams.

4 METHODOLOGY

4.1 Site Analysis and Early-Stage

Building Planning

The ﬁrst phase involves conducting a thorough site

analysis to optimize early-stage building plans. For

this, we used Autodesk Forma, which leverages AI to

assess environmental factors such as sunlight, energy

efﬁciency, and wind patterns. These factors play a

crucial role in the optimization of the architectural de-

sign, ensuring the early-stage plans are accurate and

sustainable (Chen, Abbas, et al. 2020)(Zhang and

Liu, 2021).

4.2 Design and Development of the BIM

Model

In the second phase, a Building Information Model

(BIM) is created using Autodesk Revit which makes

things easier This model incorporates architectural,

structural, and MEP (mechanical, electrical, plumb-

ing) data. After design checks and corrections the

BIM model is exported in .fbx format for compatibil-

ity with AR platforms .Exporting the model as an .fbx

format for compatibility with AR platforms. Export-

ing the model as an .fbx ﬁle enables real-time visu-

alization and interaction within AR applications (Pan

and Ismaeil, 2020). This format is widely used for in-

tegration into AR platforms, ensuring seamless visu-

alization during later stages(Kwon, Arau, et al. 2014).

4.3 AR Integration Using Vuforia and

Unity

The third phase focuses on integrating the BIM model

into Augmented Reality. Here, Vuforia SDK is em-

ployed to recognize 2D construction plans (referred to

as image targets) and overlay the 3D BIM model onto

them. Vuforia’s robust image recognition technology

INCOFT 2025 - International Conference on Futuristic Technology

402

allows users to visualize detailed 3D structures super-

imposed on real-world 2D drawings. This 3D model

is rendered using Unity, a powerful game engine that

supports AR development, creating an immersive ex-

perience for users to explore building models in a real-

world context (Nguyen and Tran, 2021).

4.4 Android Application Development

and Testing

Once the AR model is fully developed, it is compiled

into an Android application. The application allows

on-site construction teams to visualize the 3D BIM

model overlaid on 2D ﬂoor plans in real time. The

testing phase ensures the accuracy of the AR over-

lay, verifying alignment and performance on various

Android devices. Any errors identiﬁed during this

phase are corrected, and the application is retested

to ensure it functions correctly without any misalign-

ment issues(El Ammari and Hammad, 2019). The

ﬁnal product is an easy-to-use Android app that fa-

cilitates real-time construction inspections and design

veriﬁcations(Riaz and Kaleem, 2021).This methodol-

ogy leverages BIM and AR technologies to improve

the visualization, collaboration, and efﬁciency of con-

struction processes. Through detailed site analysis,

model development, AR integration, and testing, this

approach ensures accurate visualization of construc-

tion plans, thereby reducing errors and rework during

the building phase(Zhang and Liu, 2021).

5 RESULTS AND ANALYSIS

5.1 Site Utilization Analysis

The ﬁrst phase of this project focused on assessing

how effectively the site could be utilized for two

potential building designs. By analyzing the layout

and spatial organization, the following observations

were made.

Structure 1: The initial design utilized less of

the available site area, resulting in a signiﬁcant

portion of unused space, particularly along the

north and south- facing sides This design approach

provided more open areas,but it didn’t fully capitalize

on the potential for maximizing the constructed

environment.

Structure 2: Whereas the second design was

more optimized for site coverage. It strategically

used the entire plot area to incorporate a more efﬁ-

cient distribution of spaces like rooms, hallways, and

outdoor areas. This design ensured that the building

blueprint aligned with the site boundaries, leaving

minimal wasted space while providing a balanced

indoor- outdoor experience.

Conclusion: The second structure was better at

utilizing the site fully, creating a more functional

layout without compromising natural ventilation and

accessibility. By integrating rooms in strategic areas

of the plot, the structure maximized the building’s

efﬁciency.

Figure 2: Comparison of two structures.

5.2 Environmental Considerations

In the context of this project, Autodesk Forma was

used to perform in-depth environmental analysis, par-

ticularly focusing on sunlight exposure . The tool’s

ability allowed for accurate simulations and insights

that were crucial to improve the design for sustain-

ability and energy efﬁciency.

Sustainability: The combination of sunlight expo-

sure and ventilation analysis performed in Autodesk

Forma demonstrated the sustainable potential of the

design. By carefully optimizing the window place-

ments and room layouts in Structure 2, it became

clear that the building would harness more natural

light throughout the day, thereby minimizing the need

for artiﬁcial lighting. Additionally, improved natural

ventilation reduced the building’s cooling demands,

making it signiﬁcantly more energy-efﬁcient and en-

vironmentally friendly.

Figure 3: Thermal Comfort Indices.

AI-Powered BIM Based AR Application for Construction

403

5.3 BIM Model Integration

The BIM model (shown in the images) played a criti-

cal role in the analysis, offering a comprehensive 3D

visualization of both structures. This allowed for sev-

eral detailed comparisons and analyses.

The BIM model gave an accurate visualization of the

spaces and their relationships. For example, it was

easier to see how room layouts were positioned rel-

ative to site boundaries and how they interacted with

open spaces or courtyards.The 3D model provided in-

sights into roof design, elevation heights, and slopes,

which helped evaluate how well the structures would

withstand environmental elements like wind and rain-

fall.The model helps in identifying potential clashes

between structural elements (e.g., walls intersecting

with windows), which was not easily detectable in 2D

plans. This allowed for real-time adjustments and de-

sign improvements.

Figure 4: Internal view of 3D Building Information Model-

ing (BIM) model of 2D drawing.

Figure 5: External view of 3D Building Information Mod-

eling (BIM) model of 2D drawing.

5.4 Augmented Reality (AR)

Integration for Design Veriﬁcation

A key feature of this analysis was the use of AR

technology to overlay the BIM model onto the 2D

site drawings (as demonstrated in the provided AR

photos). This provided real- time insight into the

structure’s spatial behavior within its environment.

3D Model Overlay on 2D Plans: AR allows

users to project the 3D BIM model over the printed

2D plans, providing an interactive view of how the

building would appear in reality. This highlighted

any inconsistency between the designed model and

the ﬂat 2D representation.

Enhanced Visualization: The AR projection

helped visualize both the exterior and interior spaces,

making it easier to assess room sizes, window place-

ment, and circulation paths. This gave stakeholders

a realistic sense of scale and layout that’s hard to

capture in traditional 2D drawings alone.

User Interaction: The AR model could be viewed

from multiple angles, allowing users to understand

the building from various perspectives. This added

depth to the design process, enabling more informed

decisions on aesthetics and functionality.

Figure 6: Internal view of 3d model after Aug-

mented Reality(AR) integration with Building Information

Model(BIM).

6 CONCLUSION

This research highlights the transformative potential

of integrating Augmented Reality (AR) with Building

Information Modeling (BIM) in the construction in-

dustry By developing an AR-based Android applica-

tion that overlays 3D BIM models onto 2D construc-

tion plans, we aim to improve visualization, improve

error detection, and streamline the construction in-

spection process. The proposed methodology allows

construction teams to interact with digital models in

real time, facilitating better communication and col-

laboration among stakeholders. Early results suggest

that this approach can signiﬁcantly reduce misinter-

pretations of design documents, minimize costly re-

INCOFT 2025 - International Conference on Futuristic Technology

404

Figure 7: External view of complete 3D model after Aug-

mented Reality(AR) integration of Building Information

Modeling (BIM).

work, and improve overall project efﬁciency.The in-

tegration of AI in the early design stages further opti-

mizes the planning process by considering environ-

mental factors, ensuring that projects are not only

accurate but also sustainable. By empowering ﬁeld

workers with tools that enhance their understanding

of complex designs, this research paves the way for

more informed decision-making and increased ac-

countability throughout the construction process.

7 FUTURE WORK

In the future, several improvements can be made to

further enhance the integration of Augmented Real-

ity (AR) and Building Information Modeling (BIM)

in construction. One potential way is to incorporate

more advanced AI features that can predict design

problems and optimize building plans in real time

based on environmental factors. Additionally, con-

ducting more extensive ﬁeld tests with construction

teams will provide valuable feedback to improve the

usability and functionality of the application. Another

promising area is to integrate other emerging tech-

nologies, such as the Internet of Things (IoT), which

would allow real-time data sharing and better collab-

oration among project teams. These efforts will help

make construction processes more efﬁcient and accu-

rate while reducing errors and delays.

REFERENCES

Kwon, O., Arau, S., and Hartmann, T. (2014). Ad-

dressing issues in transitioning from digital de-

signs to physical construction. In Journal of Con-

struction Engineering and Management, 140(6),

04014021. https://doi.org/10.1061/(ASCE)CO.1943-

7862.0000841.

Pan, J., and Ismaeil, R. (2020). Beneﬁts of integrating

AR visualization and management in construction

projects. In Automation in Construction, 113, 103127.

https://doi.org/10.1016/j.autcon.2020.103127.

El Ammari, K., and Hammad, A. (2019). AR technology for

improving design accuracy and reducing errors in con-

struction. In Advanced Engineering Informatics, 40,

15-30. https://doi.org/10.1016/j.aei.2019.03.001.

Chen, Y., Abbas, M., and Ariano, D. (2020).

AI’s role in optimizing early-stage de-

signs and enhancing construction processes.

In Computers in Industry, 123, 103308.

https://doi.org/10.1016/j.compind.2020.103308.

Nguyen, D., and Tran, P. (2021). AI-driven defect detection

and real-time feedback through AR and BIM integra-

tion. In Journal of Construction Management, 145(8),

123-135. https://doi.org/10.1061/(ASCE)CO.1943-

7862.0002057.

Zhang, T., and Liu, M. (2021). AI-driven defect detection

using AR and BIM in construction. In Automation in

Construction, 130, 103873.

Riaz, Z., and Kaleem, S. (2021). AI-driven augmented re-

ality and BIM integration for smart construction. In

Procedia Engineering, 196, 1002-1010.

Cheng, Y., Riaz, Z., and Kaleem, A. (2021). Over-

all improvement of construction workﬂows

through AR, BIM, and AI integration. In

Journal of Building Engineering, 43, 102614.

https://doi.org/10.1016/j.jobe.2021.102614.

Grau, D., and Hartmann, F. (2019). Combining BIM and

AR for better construction planning and collaboration.

In Journal of Building Performance, 8(4), 475-486.

Kirschen, O., and Sonnentag, S. (2018). Augmented reality

and BIM: An integration to improve construction site

management. In Journal of Construction Engineering

and Management, 144(11), 04018106.

Hammad, A., and Zhang, C. (2019). BIM and augmented

reality: Bridging the gap for enhanced collaboration.

In Computing in Civil Engineering Journal, 33(3),

04019025.

Cheng, Y., Yuan, X., and Wang, L. (2021). AI and AR

for real-time BIM-based construction planning. In En-

gineering, Construction, and Architectural Manage-

ment, 28(2), 567-579.

Chen, Y., Lai, C., and Lin, C. (2020). AI-driven AR for opti-

mizing building information modeling in construction

projects. In Automation in Construction, 116, 103255.

Abbas, A., and Marino, L. (2020). AI-powered AR for en-

hancing BIM applications in construction site inspec-

tions. In Automation in Construction, 113, 103144.

AI-Powered BIM Based AR Application for Construction

405