Data Engineer
3 days ago
**Job Overview**
IGT Solutions is seeking a highly skilled Data Engineer - Technical Specialist to join our dynamic team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data pipelines using Azure Databricks and related Azure services.
Responsibilities:
- Design and develop scalable and reliable data pipelines and ETL/ELT processes using Azure Databricks and related Azure services.
- Develop, test, and implement data processing frameworks in Databricks for large-scale batch and streaming data ingestion, processing, and transformation.
- Leverage Azure Data Lake and Azure SQL Database to store and manage large datasets.
- Implement best practices for data governance, security, and data lifecycle management, ensuring data is processed securely and is accessible for appropriate business needs.
- Monitor, troubleshoot, and optimize data pipelines to ensure performance, reliability, and scalability.
- Collaborate with data scientists, analysts, and other stakeholders to understand data needs and translate business requirements into technical solutions.
- Act as a technical advisor on data engineering best practices, especially within the Azure ecosystem.
Requirements:
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Science, Engineering, or a related field.
- Minimum of 5+ years of hands-on experience in data engineering or a similar role, with at least 2 years of experience in Azure Databricks.
- Proven experience working with Azure cloud services, including Azure Data Lake, Azure SQL Database, Azure Data Factory, and Azure Synapse Analytics.
- Strong experience in ETL/ELT with streaming and batch processes, big data processing, and creating data pipelines.
- Proficiency in Python for data processing and scripting.
- Solid understanding of SQL for querying and data manipulation.
- Familiarity with data warehousing concepts and relational databases.
- Experience with performance optimization, cost management, and job scheduling on Azure Databricks.
Estimated Salary:** $120,000 - $180,000 per year (based on location and experience)
IGT Solutions offers a competitive salary, comprehensive benefits package, and opportunities for professional growth and development.
-
Network Engineering Professional
2 weeks ago
Gurgaon, Haryana, India NTT DATA Full timeJob Title: Network Engineering Professional - Advanced Routing and SwitchingAn exciting opportunity has arisen for an experienced Network Engineering Professional to join our team at NTT DATA in Delhi/NCR. We are seeking a seasoned engineer with advanced routing and switching skills to provide technical support to clients.
-
Data Engineer
2 days ago
Gurgaon, Haryana, India Talentpro Edge Full timeKey ResponsibilitiesAs a Data Engineer at Talentpro Edge, you will be responsible for exploring and acquiring new sources of data. This involves using technology to automate data acquisition and linking new sources with internal data.Ensuring Data QualityEnsure the quality and understanding of analytical data by investigating data issues and seeking...
-
Data Engineer
2 days ago
Gurgaon, Haryana, India Coders Brain Technology Private Limited Full timeAbout the Role:Coders Brain Technology Private Limited is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will design, build, and maintain scalable data pipelines using Apache Spark and Spark Streaming for real-time data processing.Key Responsibilities:• Design and implement data ingestion, transformation, and enrichment...
-
Data Engineer
1 month ago
Gurgaon, Haryana, India Synechron Full timeAt Synechron, we're looking for a talented Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities• Develop, construct, test, and maintain architectures such as databases and large-scale processing...
-
Data Engineering Director
3 weeks ago
Gurgaon, Haryana, India Metyis Full timeOverviewMetyis, a fast-growing international company, seeks a seasoned Data Engineering Lead to drive impactful change in our clients' businesses. This role offers an exceptional opportunity for a talented individual to leverage their expertise in data engineering to shape the future of our clients' digital transformation.About the RoleWe are looking for a...
-
Data Engineering Lead
1 month ago
Gurgaon, Haryana, India Publicis Sapient Full timeData Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at Publicis Sapient. In this role, you will be responsible for defining and executing data strategy for clients.Data Integration, Governance & WranglingData Storage and Computation Frameworks, Performance OptimizationsAnalytics & VisualizationsInfrastructure & Cloud...
-
Data Engineering Leader
1 day ago
Gurgaon, Haryana, India TalentXO Full timeAt TalentXO, we're looking to hire an experienced Data Engineering Leader for one of our clients in the EduTech industry.Company OverviewOur client offers online cohort-based courses for architects, engineers, and designers from 45+ countries worldwide. They collaborate with global firms like Autodesk, BIG, Google, UNStudio, AECOM, and their graduates are...
-
Data Architect and Engineer
3 weeks ago
Gurgaon, Haryana, India Snap Find Full timeCompany OverviewNovatr is a rapidly growing startup that empowers architects, engineers, and AEC professionals with cutting-edge technology skills.About the RoleWe are seeking an experienced Data Architect and Engineer to join our team. As a Senior Data Engineer at Novatr, you will design, implement, and optimize scalable and efficient data architectures and...
-
Data Engineering Specialist
2 weeks ago
Gurgaon, Haryana, India The Nielsen Company Full timeAbout NielsenWe champion career growth as a partnership. At Nielsen, you own your journey and fuel it with our support.Our community of nearly 14,000 associates will help you succeed. When you grow, we do too.About the RoleNielsen seeks a detail-oriented, organized team player to join OpIntel in the role of Data Engineer.Minimum Qualification:Bachelor's...
-
Data Engineering Lead
1 week ago
Gurgaon, Haryana, India NAB Full timeNAB is seeking an experienced Data Engineer to join our team.Job Title: Data Engineering LeadSalary:$120,000 - $160,000 per annumAbout the Role:We are looking for a skilled Data Engineer to lead our data engineering efforts. The successful candidate will have a strong background in SQL, Python, and experience with source code control (GitHub) and Jenkins....
-
Data Engineering Specialist
1 week ago
Gurgaon, Haryana, India Collabera Digital Full timeCollabera Digital is seeking an experienced Data Engineer to join our team in Pune, India.About the RoleThis is a fantastic opportunity for a skilled Data Engineer to work on various data engineering tasks, including designing and implementing data pipelines, optimizing performance, and ensuring data quality.Key ResponsibilitiesDesign, develop, and deploy...
-
Data Systems Engineer
1 month ago
Gurgaon, Haryana, India Siemens Energy Full timeAbout the RoleData Systems Engineer required for Siemens Energy. About the RoleAs a Data Systems Engineer, you will work in our Data Lake team to develop and implement data solutions. Your profileBachelor's degree in computer science or related fieldExperience in data engineering, data architecture, and data scienceStrong communication and analytical...
-
Data Engineering Specialist
2 weeks ago
Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full timeAt Spectral Consultants, we are on the hunt for a talented Data Engineering Specialist to join our team. This is an exciting opportunity for a skilled professional to design and implement large-scale data processing pipelines using Hive, Spark, Hadoop, and MapReduce.We are looking for someone with hands-on experience in building scalable and efficient data...
-
Senior Data Engineer
6 days ago
Gurgaon, Haryana, India Petonic Infotech Pvt. Ltd. Full timeJob Title : Senior Data EngineerAt Petonic Infotech Pvt. Ltd., we are seeking a skilled Senior Data Engineer to play a pivotal role in our AI-driven projects. As a key member of our data team, you will be responsible for designing, developing, and maintaining robust data pipelines, managing APIs, and collaborating with data scientists to ensure high-quality...
-
Data Architect
2 days ago
Gurgaon, Haryana, India Impetus Full timeJob SummaryWe are seeking a skilled Data Architect - Big Data Engineer to join our team at Impetus. As a key member of our data engineering team, you will design, develop, and implement efficient ETL pipelines using big data technologies.About the RoleDevelop scalable and secure data pipelines using Hadoop, Hive, and PySpark.Collaborate with cross-functional...
-
Data Engineer Position
3 weeks ago
Gurgaon, Haryana, India NAB Full timeAbout the RoleWe are seeking a highly skilled Data Engineer to join our team at NAB. As a key member of our data engineering team, you will play a critical role in designing, developing, and implementing large-scale data processing systems.
-
Data Engineering Lead
2 days ago
Gurgaon, Haryana, India Advatix Full timeJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Advatix. The ideal candidate will have a strong background in data engineering, with experience in designing and implementing data pipelines, data warehouses, and big data environments.The successful candidate will have excellent analytical and problem-solving skills, with...
-
Senior Data Engineer
2 months ago
Gurgaon, Haryana, India Habilelabs Pvt. Ltd. Full timeJob Title: Senior Data EngineerAbout Habilelabs Pvt. Ltd.Habilelabs Pvt. Ltd. is a leading technology company that specializes in developing innovative solutions for the data engineering space. We are seeking a highly skilled and motivated Senior Data Engineer to join our development team in Gurgaon.Job Description:We are looking for a talented Senior Data...
-
Data Engineer
3 weeks ago
Gurgaon, Haryana, India exl Full timeJob DescriptionWe are seeking a skilled Data Engineer to join our team as a Big Data Architect. This is an exciting opportunity to work with cutting-edge technology and contribute to the design and implementation of large-scale data processing systems.About EXLEXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses...
-
Data Engineer Tester
1 month ago
Gurgaon, Haryana, India Hiring House Technology Full timeAbout the RoleHiring House Technology is seeking a skilled Data Engineer Tester to join our team. The ideal candidate will have experience in Data Engineering, ETL testing, and Quality Assurance.Key ResponsibilitiesDevelop and execute test plans to ensure data quality and integrity.Collaborate with Data Engineering teams to identify and resolve data-related...