Data Engineer
3 weeks ago
Position: Data Engineer
Experience Level: 7+ years
Location: (Remote)
Job Type: Full-Time
Job Summary:
The Azure Data Factory & Power BI Developer will be responsible for designing, developing, and managing data integration solutions using Azure Data Factory, as well as creating visually compelling dashboards and reports using Power BI. You will work closely with business stakeholders to understand their data needs, extract, transform, and load data from various sources, and transform data into insightful, actionable reports for decision-making.
Key Responsibilities:
Azure Data Factory Development:
Design, develop, and maintain scalable and efficient ETL pipelines using Azure Data Factory (ADF) for extracting, transforming, and loading data from multiple on-premises and cloud sources to Azure-based storage solutions.
Create, configure, and manage linked services, datasets, pipelines, and triggers within Azure Data Factory.
Automate and schedule data workflows using ADF to handle both real-time and batch data processing.
Ensure data pipelines are optimized for performance and scalability, meeting operational SLAs.
Power BI Development:
Design and develop Power BI dashboards, reports, and data visualizations that align with business requirements and provide actionable insights.
Implement complex DAX measures, Power Query transformations, and custom visuals for optimized reporting.
Develop and maintain Power BI data models that support high-performance querying and reporting.
Integrate Power BI with data from various sources, ensuring seamless and secure data flow from backend systems (Azure Data Lake, SQL Database, Data Warehouses, etc.).
Data Modeling & Integration:
Work closely with data engineers and architects to create data models that ensure data is structured for efficient querying and reporting.
Design and implement data integration solutions that enable a seamless flow of data between source systems and Power BI reports.
Collaboration & Requirements Gathering:
Engage with business stakeholders to understand data needs, define reporting requirements, and translate them into technical solutions.
Collaborate with data engineers to integrate new data sources and ensure data consistency and accuracy in reports.
Performance Optimization:
Tune both Azure Data Factory pipelines and Power BI reports for high performance, focusing on query optimization, resource utilization, and report loading times.
Security & Governance:
Implement security and data governance best practices to ensure sensitive data is protected and compliant with relevant regulations (e.g., GDPR, HIPAA).
Ensure role-based access and secure data-sharing policies are implemented within Power BI and Azure Data Factory .
Documentation & Support:
Provide comprehensive documentation on ETL processes , data models, and Power BI report designs.
Provide ongoing support for production environments, monitor data workflows, and troubleshoot performance or data-related issues.
Required Skills & Qualifications:
Experience: At least 7 years of experience in data integration, ETL development, and data visualization, with a strong focus on Azure Data Factory and Power BI .
Azure Data Factory Expertise: Proficient in Azure Data Factory for creating and managing data pipelines, and working with linked services, datasets, and triggers. Experience with Azure Data Lake, Blob Storage, and SQL-based solutions is a must.
Power BI Development: Strong experience in Power BI dashboard/report creation, DAX, Power Query, data modeling, and advanced visualization techniques.
SQL Skills: Advanced knowledge of SQL for querying and transforming data. Experience with database management systems such as SQL Server, Azure SQL Database, or other relational databases.
ETL Process Knowledge: Strong understanding of ETL processes and data integration best practices for cloud-based data solutions.
Data Modeling: Knowledge of data warehousing and dimensional data modeling concepts, as well as the ability to design efficient and scalable data models.
Cloud Expertise: Experience with Azure cloud technologies, including Azure Data Lake , Azure SQL , Azure Synapse Analytics , and related Azure data services.
Performance Optimization: Proven ability to optimize the performance of both Azure Data Factory pipelines and Power BI reports, ensuring that they meet performance and scalability standards.
Problem-Solving: Strong analytical skills and the ability to troubleshoot complex data issues, identify root causes, and implement solutions quickly.
Communication Skills: Excellent verbal and written communication skills with the ability to interact with stakeholders, both technical and non-technical.
Agile Methodology: Experience working in Agile environments, using tools such as Jira , Azure DevOps , or similar.
Desirable Skills:
Certification in Microsoft Azure Data Engineer or Power BI .
Experience with Azure Synapse Analytics , Azure Databricks , and other advanced data engineering services.
Knowledge of advanced data visualization techniques and custom visuals within Power BI.
Familiarity with data governance frameworks and compliance standards (e.g., GDPR, HIPAA).
Familiarity with version control systems such as Git .
Education:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field. Master's degree or relevant certifications (e.g., Microsoft Azure Data Engineer) is a plus.
-
delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Data Warehouse Engineer
1 week ago
Delhi, India Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Senior Data Integration Engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:- Design and architect integration solutions to connect various enterprise applications, systems, and databases.- Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.- Utilize Azure Integration Services such as Azure Logic...
-
Senior data integration engineer
2 weeks ago
Delhi, India Senior Data Integration Engineer Full timeMust Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...
-
Lead data engineer
3 weeks ago
Delhi, India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, Py Spark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Data Platform Engineer
2 days ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data platform engineer
2 days ago
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...
-
Data Platform Engineer
2 days ago
Delhi, India OSD Data Services Full timeData Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
AWS Data Engineer
4 weeks ago
delhi, India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
4 months ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
1 month ago
delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
Aws data engineer
4 weeks ago
Delhi, India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on Py Spark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Delhi, India OSD Data Services Full timeData Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...
-
Data Unveil | Quality Assurance Engineer
22 hours ago
delhi, India Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...
-
Data Unveil | Quality Assurance Engineer
2 days ago
Delhi, India Data Unveil Full timeAbout us: At Data Unveil, we believe in delivering the best for our clients (Pharma Companies). We use the latest technology and tools to aggregate and analyze specialty healthcare data received from various data partners. We provide clear and hassle-free business insights to enhance the client’s vision and drive business success.Position Title: QA...
-
Data Dynamics | Storage Solutions Architect
21 hours ago
delhi, India Data Dynamics Full timeCompany Description Data Dynamics is a global leader in enterprise data management, focusing on Digital Trust and Data Democracy. Trusted by over 300 organizations, including 25% of the Fortune 20, Data Dynamics is committed to creating a transparent, unified, and empowered data ecosystem. The company's AI-powered self-service data management software...
-
Business Development Representative
2 weeks ago
Delhi, Delhi, India Hevo Data Full timeAbout Hevo DataWe are a cutting-edge data integration platform that empowers businesses to unlock the full potential of their data.Salary: $70,000 - $100,000 per annumJob DescriptionWe are seeking an exceptional Business Development Representative to join our team. As a key member of our sales organization, you will play a critical role in identifying and...
-
Wavicle Data Solutions | Senior Data Scientist
22 hours ago
delhi, India Wavicle Data Solutions Full timeJob Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...