Data Engineer

1 week ago

Delhi Division, India EGISEDGE TECHNOLOGIES PVT LTD Full time

Job Title :Data Engineer at Egisedge Technologies Pvt Ltd is a highly skilled role that involves designing, developing, and maintaining scalable ETL/ELT data pipelines using Databricks (PySpark) on Azure/AWS/GCP.Key Responsibilities :- Design, develop, and maintain scalable ETL/ELT data pipelines using Databricks (PySpark) on Azure/AWS/GCP.- Develop clean, reusable, and performant Python code for data ingestion, transformation, and quality checks.- Write efficient and optimized SQL queries for querying structured and semi-structured data.- Work with stakeholders to understand data requirements and implement end-to-end data workflows.- Perform data profiling, validation, and ensure data quality and integrity.- Optimize data pipelines for performance, reliability, and integrate data from various sources APIs, flat files, databases, cloud storage e.g, S3, ADLS.- Build and maintain delta tables using Delta Lake format for ACID-compliant streaming and batch pipelines.- Work with Databricks Workflows to orchestrate pipelines and scheduled jobs.- Collaborate with DevOps and cloud teams to ensure secure, scalable, and compliant infrastructure.Technical Skills Required :Core Technologies :- Databricks Spark on Databricks, Delta Lake, Unity Catalog- Python with strong knowledge of PySpark- SQL Advanced level joins, window functions, CTEs, aggregationETL & Orchestration :- Databricks Workflows / Jobs- Airflow, Azure Data Factory, or similar orchestration tools- AUTO LOADER Structured Streaming preferredCloud Platforms Any one or more :- Azure Databricks on Azure, ADLS, ADF, Synapse- AWS Databricks on AWS, S3, Glue, Redshift- GCP Dataproc, BigQuery, GCSData Modeling & Storage :- Experience working with Delta Lake, Parquet, Avro- Understanding of dimensional modeling, data lakes, and lakehouse architecturesMonitoring & Version Control :- CI/CD pipelines for Databricks via Git, Azure DevOps, or Jenkins- Logging, debugging, and monitoring with tools like Datadog, Prometheus, or Cloud-native toolsOptional/Preferred :- Knowledge of MLflow, Feature Store, or MLOps workflows- Experience with REST APIs, JSON, and data ingestion from 3rd-party services- Familiarity with DBT Data Build Tool or Great Expectations for data qualitySoft Skills :- Strong analytical, problem-solving, and debugging skills- CLEAR communication and documentation skills- Ability to work independently and within cross-functional teams- Agile/Scrum working experience (ref:hirist.tech)

  • Data Engineer

    3 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI SolutionsReports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data engineer

    3 weeks ago

    Delhi, India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions ArchitectTravel: International travel required (up to 30–40%)Position Summary:  We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+ years of...

  • Data Engineer

    3 weeks ago

    Delhi, India Data-Hat AI Full time

    Department:Data Engineering & AI SolutionsReports To:Lead Data Solutions ArchitectTravel:International travel required (up to 30–40%)Position Summary:We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructurethat underpins mission-critical AI systems. With 12+ years of experience,...

  • Platform Data Engineer

    2 weeks ago

    Delhi Division, India Insight Global Full time

    Key Responsibilities - Administer and optimize Azure Databricks, including clusters, jobs, and user access. - Manage Snowflake environments (warehouses, roles/permissions, performance tuning, cost optimization). - Design, implement, and monitor Azure Data Factory (ADF) pipelines for batch and streaming workloads. - Enable data movement and replication across...

  • Senior Data Engineer

    2 weeks ago

    Delhi Division, India Baazi Games Full time

    As a Data Engineer at Baazi Games, you will be focused on delivering data-driven insights to various functional teams enabling them to make strategic decisions that add value to the top or bottom line of the business.What you will do● Design, build and own all the components of a high-volume data hub.● Build efficient data models using industry best...

  • Baazi Games

    2 weeks ago

    Delhi Division, India Baazi Games Private Limited Full time

    Description :As a Data Engineer at Baazi Games, you will be focused on delivering data-driven insights to various functional teams enabling them to make strategic decisions that add value to the top or bottom line of the business.What you will do :- Design, build and own all the components of a high-volume data hub.- Build efficient data models using...

  • Data Engineer

    1 week ago

    Delhi Division, India Brainwork TechnoSolutions Pvt. Ltd Full time

    Job Description : We are seeking a highly skilled and experienced data engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and implementing robust and scalable data pipelines using Python, SQL, BigQuery, and Airflow or similar orchestration tools.Data Engineering Expertise : The ideal...

  • Kuoni Tumlare

    3 weeks ago

    Delhi Division, India Kuoni Tumlare Full time

    Key Responsibilities :- Develop robust data pipelines and ETL workflows using Python and Apache Spark.- Orchestrate complex workflows using Databricks Workflows or Azure Data Factory.- Translate business rules, retention metadata, and data governance policies into reusable, modular, and scalable pipeline components.- Ensure adherence to data privacy,...

  • Data Engineering Lead

    1 week ago

    Delhi Division, India SMARTWORK IT SERVICES Full time

    Position : Data Engineering LeadExperience : 915 YearsLocation : PAN IndiaJob Summary : We are seeking a highly skilled and experienced Data Engineering Lead with 9 to 15 years of hands-on expertise in AWS and Snowflake. The ideal candidate will be a solution-oriented professional capable of designing, developing, and delivering scalable data engineering...

  • Senior/Lead Data Engineer

    3 weeks ago

    Delhi, India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...