
Senior Data Engineer
2 days ago
Job Description:
As an ETL Developer, you will be responsible for designing, building, and maintaining ETL pipelines using MSBI stack, Azure Data Factory (ADF) and Fabric. You will work closely with data engineers, analysts, and other stakeholders to ensure data is accessible, reliable, and processed efficiently.
Key Responsibilities:
- Design, develop, and deploy ETL pipelines using ADF and Fabric.
- Collaborate with data engineers and analysts to understand data requirements and translate them into efficient ETL processes.
- Optimize data pipelines for performance, scalability, and robustness.
- Integrate data from various sources, including S3, relational databases, and APIs.
- Implement data validation and error handling mechanisms to ensure data quality.
- Monitor and troubleshoot ETL jobs to ensure data accuracy and pipeline reliability.
- Maintain and update existing data pipelines as data sources and requirements evolve.
- Document ETL processes, data models, and pipeline configurations.
Qualifications:
- Experience: 3+ years of experience in ETL development, with a focus on ADF, MSBI stack, SQL, Power BI, Fabric.
- Technical Skills:
- Strong expertise in ADF, MSBI stack, SQL, Power BI.
- Proficiency in programming languages such as Python or Scala.
- Hands-on experience with ADF, Fabric, Power BI, MSBI.
- Solid understanding of data warehousing concepts, data modeling, and ETL best practices.
- Familiarity with orchestration tools like Apache Airflow is a plus.
- Data Integration: Experience with integrating data from diverse sources, including relational databases, APIs, and flat files.
- Problem-Solving: Strong analytical and problem-solving skills with the ability to troubleshoot complex ETL issues.
- Communication: Excellent communication skills, with the ability to work collaboratively with cross-functional teams.
- Education: Bachelor's degree in computer science, Engineering, or a related field, or equivalent work experience.
Nice to Have:
- Experience with data lakes and big data processing.
- Knowledge of data governance and security practices in a cloud environment.
-
Senior Administration Executive
2 days ago
Ahmedabad, Gujarat, India Technobeat Engineer Full time ₹ 1,04,000 - ₹ 1,30,878 per yearWe are seeking a dedicated Senior Admin Executive. The role is to manage and preparation of reports, ensure accuracy, and maintain monthly documentation. Responsible for collecting data from engineers, guiding team in report creation, and submission.
-
Senior Software Engineer/Technical Lead
1 day ago
Ahmedabad, Gujarat, India Crest Data Full time US$ 90,000 - US$ 1,20,000 per yearCompany Overview:Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics. The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...
-
Senior Data Engineer
1 week ago
Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full timeRole: Senior Data EngineerYears of Experience: 5-8 YearsLocation: Ahmedabad, Pune, IndoreNotice Period: Immediate to 45 Days MaxJob Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics...
-
Senior Data Engineer
7 days ago
Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full timeRole: Senior Data EngineerYears of Experience: 5-8 YearsLocation: Ahmedabad, Pune, IndoreNotice Period: Immediate to 45 Days MaxJob Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics...
-
Senior Data Engineer
2 days ago
Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full time ₹ 15,00,000 - ₹ 20,00,000 per yearRole: Senior Data EngineerYears of Experience: 5-8 YearsLocation: Ahmedabad, Pune, IndoreNotice Period: Immediate to 45 Days MaxJob Description:We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics and...
-
Senior Data Engineer
5 days ago
Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full timeRole: Senior Data Engineer Years of Experience: 5-8 Years Location: Ahmedabad, Pune, Indore Notice Period: Immediate to 45 Days Max Job Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data...
-
Senior Data Engineer
13 hours ago
Ahmedabad, Gujarat, India eInfochips (An Arrow Company) Full timeRole: Senior Data EngineerYears of Experience: 5-8 YearsLocation: Ahmedabad, Pune, IndoreNotice Period: Immediate to 45 Days MaxJob Description: We are seeking a highly motivated and enthusiastic Senior Data Engineer with 5- 8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Data Engineering/Data analytics...
-
Senior Software Engineer/Technical Lead
3 days ago
Ahmedabad, Gujarat, India Crest Data Systems Full timeCompany Overview :Crest Data is a leading provider of data center solutions and engineering/marketing services in the areas of Networking/SDN, Storage, Security, Virtualization, Cloud Computing, and Big Data / Data Analytics.The team has extensive experience in building and deploying various Data Center products from Cisco, VMware, NetApp, Amazon AWS, EMC,...
-
Senior Data Engineer
1 day ago
Ahmedabad, Gujarat, India Krish Technolabs Full time ₹ 15,00,000 - ₹ 20,00,000 per yearThe Senior Data Engineer is a key technical leader responsible for architecting and building large-scale, enterprise-level data platforms. You will mentor junior engineers, define best practices, and drive the strategic vision for our data infrastructure.What Youll Be DoingDesign and architect complex, scalable, and reliable data pipelines and data...
-
Senior Data Engineer
3 days ago
Ahmedabad, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job TitleA senior data engineer is required to design, build and operate production-grade data pipelines. The ideal candidate will lead delivery, set technical direction, coach engineers and coordinate work across time zones.About the RoleData Engineering Expertise: Lead a small squad or workstream; scope milestones; manage dependencies and risks; unblock...