Data Engineer
2 weeks ago
Job Title : Data Engineer
Location : Gurugram, Delhi
Experience : 3-5 Years
Budget : 24 LPA
Work Mode : Work From Office (WFO)
Interview Mode : Virtual
Must-Have Skills : PySpark, Databricks, ML Flow, Azure DevOps, SQL
Job Description :
We are seeking a skilled Data Engineer to design, build, and maintain data pipelines, data architectures, and ETL processes using advanced tools and technologies. The ideal candidate will have hands-on experience with PySpark, Databricks, and Azure DevOps, and will be proficient in building scalable solutions for data processing and analytics.
As a Data Engineer, you will collaborate with global teams, including data science and business intelligence, to ensure efficient data handling and gain insights that drive business decisions
Key Responsibilities :
- Data Pipeline Development: Design and build data pipelines using Spark-SQL and PySpark within Azure Databricks to handle large datasets efficiently.
- ETL Pipeline Design: Develop ETL pipelines using Azure Data Factory (ADF) for robust data transformation and integration.
- Lakehouse Architecture: Build and maintain a Lakehouse architecture in ADLS/Databricks, ensuring scalable and efficient data storage and processing.
- Data Preparation: Perform data preparation tasks including cleaning, normalization, deduplication, and type conversion for optimized data usability.
- Collaboration with DevOps: Work closely with the DevOps team to deploy data solutions in production environments using Azure DevOps.
- Error Handling: Monitor data processes, identify errors, and execute corrective actions, ensuring data integrity. This includes troubleshooting and resolving root causes of data errors.
- Global Team Collaboration: Participate as a member of the global analytics team, collaborating on projects, sharing insights, and adopting best practices from data science and business intelligence colleagues.
- Project Leadership: Lead and participate in projects, applying change management tools to manage upgrades, changes, and data migrations. This includes training, documentation, and communication efforts.
Qualifications :
- 3 to 5 years of experience in data engineering, with a strong focus on PySpark, Databricks, and Azure DevOps.
- Expertise in designing and building ETL pipelines using ADF.
- Strong knowledge of Lakehouse architecture and ADLS/Databricks.
- Solid experience with SQL for database queries and data management.
- Proven ability to collaborate with global teams and lead data projects.
- Strong problem-solving skills and attention to detail in managing data processes and errors.
-
Data Engineer
2 weeks ago
Gurgaon/Gurugram, India Paddlelift Full timeJob Description : You will work closely with the data analytics team to analyze and interpret data, develop data visualizations, and assist in data-driven decision-making processes. This includes collecting and cleaning data, conducting data analysis using statistical software, and creating reports and presentations to communicate insights.Requirements : -...
-
Data Engineer
2 weeks ago
Gurgaon/Gurugram, India Unifocus Full timeUnifocus (formerly Knowcross) is an integrated workforce management software platform offering intelligent automation for daily work orders management, housekeeping activities, facility maintenance, survey solutions, scheduling & labour management, and time & attendance built for the hospitality market and other dynamic scheduling environment.We support...
-
Network Engineering Professional
2 weeks ago
Gurgaon, Haryana, India NTT DATA Full timeJob Title: Network Engineering Professional - Advanced Routing and SwitchingAn exciting opportunity has arisen for an experienced Network Engineering Professional to join our team at NTT DATA in Delhi/NCR. We are seeking a seasoned engineer with advanced routing and switching skills to provide technical support to clients.
-
Senior Data Engineer
2 weeks ago
Gurgaon/Gurugram, India Altudo Full timeWe have a unique career opportunity for an experienced Data Engineer to play a key role in the growth of the Analytics practice. You will work with Altudo' s clients to deliver cutting-edge data & analytics solutions using modern data platforms such as Databricks, Snowflake and Microsoft Fabric. You will play a key role in leading complex engagements....
-
Data Engineer
2 weeks ago
Gurgaon/Gurugram, India IFLOWTECH SOLUTIONS PRIVATE LIMITED Full timeRole : Data Engineerlocation : GurugramExperience : Must have 5+ Years Primary Skills : Python, Pyspark, SQL, Hive, Data Ware Housing, Data Modelling, Tableau/Power BI, Data Migration, Source to Target MappingKey Responsibilities : - Independently run workshops and interviews with appropriate stakeholders (data owners from Business, Service and Product...
-
Data Engineer
2 weeks ago
Gurgaon/Gurugram, India Coders Brain Technology Private Limited Full timeJob Title : ML - Data EngineerLocation : Gurugram, HaryanaJob Type : Full-TimeNotice period : Immediate Joiners OnlyAbout Us :Coders Brain is a global leader in its services, digital and business solutions that partners with its clients to simplify, strengthen and transform their businesses. We ensure the highest levels of certainty and satisfaction through...
-
Data Engineer
4 weeks ago
Gurgaon, India mccainfood Full timePosition Title: Data EngineerPosition Type: Regular - Full-Time Position Location: New Delhi Requisition ID: 33103 Position SummaryData Engineers are primarily responsible for designing, building, managing, and operationalizing data pipelines in support of key data and analytics use cases. They are accountable for guaranteeing compliance...
-
Data Engineer
3 weeks ago
Gurugram, India StatusNeo Full timeJob description Job Title: Data Engineer Company: StatusNeo About At StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...
-
Data Engineer
3 weeks ago
Gurugram, India StatusNeo Full timeJob descriptionJob Title: Data EngineerCompany: StatusNeoAboutAt StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...
-
Data Engineer
3 weeks ago
Gurugram, India StatusNeo Full timeJob descriptionJob Title: Data EngineerCompany: StatusNeoAboutAt StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...
-
Data engineer/senior data engineer
2 weeks ago
Gurgaon, India Cognitio Analytics Inc Full timeExperience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev Ops ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics,...
-
Data Engineer
3 weeks ago
Gurgaon, India StatusNeo Full timeJob descriptionJob Title: Data EngineerCompany: StatusNeoAboutAt StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background in data...
-
Data Engineer
2 weeks ago
Gurgaon/Gurugram, India OMEGA HIRES CONSULTANCY Full timeJob Description : - Design, build, and maintain scalable and efficient data pipelines using GCP tools such as Cloud Dataflow, Cloud Composer, and Cloud Functions.- Extract data from various sources (e. , databases, files, APIs) and transform it into a suitable format for analytics.- Load data into GCP data stores like BigQuery, Cloud Storage, and Data...
-
IT Manager
2 weeks ago
Gurgaon/Gurugram, India Spectral Consultants – Search & Recruitment firm Full timeJob Description : We are looking for an experienced Cloud and Data Manager to provide strategic and technical direction to help deliver our next-generation solutions using cloud-based technologies. This role requires expertise around data quality and maintaining the production environment, where the delivered solutions are executing on daily basis. You...
-
Data Engineer
2 months ago
gurugram, India Nutrabay Full timeWe are seeking a skilled Data Engineer to join our team. The ideal candidate will be responsible for handling the movement of data from various sources to our data warehouses and data lakes. The candidate should have a strong understanding of data engineering concepts and experience working with databases such as Redshift, MySQL, and technologies like Athena...
-
Data engineer/senior data engineer
2 weeks ago
Gurgaon, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ PysparkAzure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, Bit Bucket, Version control, Azure Dev OpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...
-
Data Engineer
3 weeks ago
Gurgaon, India StatusNeo Full timeJob description Job Title: Data Engineer Company: StatusNeo About At StatusNeo, we are on a mission to redefine the future of data-driven decision-making. We are looking for a passionate and talented Junior Data Engineer to join our dynamic team. If you have up to one year of experience or are fresh out of college with a strong academic background...
-
Data Engineer/Senior Data Engineer
3 weeks ago
Gurugram, India Cognitio Analytics Inc Full timeExperience:1 to 8 years - DE/ Sr. DE/ AM /ManagerMust Have:SQLPython/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOpsETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data SecurityAgile Practices, SDLCData Exploration, Data Quality metrics, Historical data Management, Good...
-
Data Engineer/Senior Data Engineer
3 weeks ago
Gurugram, India Cognitio Analytics Inc Full timeExperience: 1 to 8 years - DE/ Sr. DE/ AM /Manager Must Have: SQL Python/ Pyspark Azure Databricks, ADLS Gen 2 Blob Storage, Key Vaults, BitBucket, Version control, Azure DevOps ETL, Building Data Pipelines, Data Warehousing, Data Modelling and Governance, Data Security Agile Practices, SDLC Data Exploration, Data Quality metrics, Historical data...
-
Data engineer
4 weeks ago
Gurgaon, India Markovate Full timeJob Summary We are seeking a skilled and motivated Data Engineer with a strong background in data integration, ETL processes, and data warehousing. The ideal candidate will have over 2 years of experience in data engineering, with a good understanding of data architecture, pipeline creation, and big data technologies. This role requires a proactive...