Lead Data Engineer

4 weeks ago

Jaipur, India Orbion Infotech Full time

Description :Key Responsibilities :- Lead the design and implementation of modern data platforms across Azure, AWS, and Snowflake.- Translate business requirements into robust technical solutions covering ingestion, transformation, integration, warehousing, and validation.- Architect, build, and maintain data pipelines for analytics, reporting, and machine learning use cases.- Develop and maintain ETL processes to move data from multiple sources into cloud data lakes and warehouses.- Design and implement data models, lineage, and metadata management to ensure consistency and traceability.- Optimize pipelines and workflows for performance, scalability, and cost efficiency.- Enforce data quality, security, and governance standards across all environments.- Support migration of legacy/on-premises ETL solutions to cloud-native platforms.- Develop and tune SQL queries, database objects, and distributed processing workflows.- Drive adoption of CI/CD, test automation, and DevOps practices in data engineering.- Collaborate with architects, analysts, and data scientists to deliver end-to-end data solutions.- Provide technical leadership, mentorship, and training to junior engineers.- Produce and maintain comprehensive technical documentation.Requirements & Skills :- Strong experience designing and developing ETL/data pipelines on Azure, AWS, and Snowflake.- Proficiency in SQL, Python, and distributed processing (e.g., Spark, Databricks, EMR).- Hands-on expertise with :1. Azure : Data Factory, Synapse, Databricks, Azure SQL2. AWS : Glue, Redshift, S3, Lambda, EMR3. Snowflake : Data warehousing, performance optimization, security features- Solid understanding of data modeling, lineage, metadata management, and governance.- Experience with CI/CD, infrastructure-as-code, and automation frameworks.- Strong problem-solving and communication skills with the ability to work across teams.Desired Profile :- Bachelors or masters degree in computer science, Engineering, or related discipline.- 6 - 10 years of progressive data engineering experience, with at least 5 years in cloud-based data platforms.- Strong expertise in data modelling, database design, and warehousing concepts.- Proficiency in Python (including Pandas, API integrations, and automation).- Familiarity with varied data formats and sources (CSV, Parquet, JSON, APIs, relational and NoSQL databases).- Exposure to modern orchestration and workflow tools, with strong understanding of CI/CD practices.- Experience with Databricks and Microsoft Fabric is a plus.- Excellent analytical, problem-solving, and communication skills.- Ability to evaluate new technologies and adopt them where appropriate. (ref:hirist.tech)

  • Lead/Senior Data Engineer

    2 weeks ago

    Jaipur, Rajasthan, India 80161b78-3cc4-4a86-a077-b6a3c33bfbb5 Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    Job DescriptionLead Data Engineer - 8+ yearsSenior Data Engineer - 3+ yearsSkills: Scala, Python, DataBricks, Apache PySparkEMPLOYMENT TYPE: Full-Time, PermanentLOCATION: Remote (Pan India)SHIFT TIMINGS: 2.00 pm-11:00 pm ISTBudget- As per company standardsREPORTING: This position will report to our CEO or any other Lead as assigned by Management.The...

  • Data Operation Lead

    2 weeks ago

    Jaipur, India r3 Consultant Full time

    Data Operation Lead  Location- Jaipur WFO Budget- Open as per market standards Exp- 7-10 yrs 1 position open 5 days working Shift Timings- 10-7  Job Description:  The Data Operations Lead will oversee and manage the data operations team responsible for  data analysis, query development, and the execution of data-driven initiatives. This role ensures ...

  • Data Operations Lead

    2 weeks ago

    Jaipur, India PASO Co Full time

    Job description We’re Hiring: Data Operations Lead Shift: 10:00 AM – 07:00 PM IST Positions: 1 | Type: Full-Time What You’ll Be Doing: ● Lead and manage the Data Operations team responsible for data collection, enrichment, validation, and delivery. ● Implement and monitor data quality metrics, identify discrepancies, and drive process improvements....

  • Data Operations Lead

    2 weeks ago

    Jaipur, India PASO Co Full time

    Job description 💼 We’re Hiring: Data Operations Lead Shift: 10:00 AM – 07:00 PM IST Positions: 1 | Type: Full-Time What You’ll Be Doing: ● Lead and manage the Data Operations team responsible for data collection, enrichment, validation, and delivery. ● Implement and monitor data quality metrics, identify discrepancies, and drive process...

  • Data operations lead

    3 weeks ago

    Jaipur, India PASO Co Full time

    Job description ???? We’re Hiring: Data Operations Lead Shift: 10:00 AM – 07:00 PM IST Positions: 1 | Type: Full-Time What You’ll Be Doing: ● Lead and manage the Data Operations team responsible for data collection, enrichment, validation, and delivery. ● Implement and monitor data quality metrics, identify discrepancies, and drive process...

  • Data Operations Lead

    3 weeks ago

    Jaipur, India PASO Co Full time

    Job description We’re Hiring: Data Operations Lead Shift: 10:00 AM – 07:00 PM IST Positions: 1 | Type: Full-Time What You’ll Be Doing: ● Lead and manage the Data Operations team responsible for data collection, enrichment, validation, and delivery. ● Implement and monitor data quality metrics, identify discrepancies, and drive process improvements....

  • Data Operations Lead

    4 weeks ago

    Jaipur, India Hunarstreet Technologies Pvt Ltd Full time

    Data Operations Lead will oversee and manage the data operations team responsible for data analysis, query development, and the execution of data-driven initiatives. This role ensures the effective management, organization, and delivery of high-quality data across prospect, customer, and internal projects. The Data Operations Lead will guide the team in...

  • Data Operations Lead

    3 weeks ago

    Jaipur, India PASO Co Full time

    Job description💼 We’re Hiring: Data Operations LeadShift: 10:00 AM – 07:00 PM ISTPositions: 1 | Type: Full-TimeWhat You’ll Be Doing:● Lead and manage the Data Operations team responsible for data collection, enrichment,validation, and delivery.● Implement and monitor data quality metrics, identify discrepancies, and drive processimprovements.●...

  • Data Operations Lead

    3 weeks ago

    Jaipur, India PASO Co Full time

    Job descriptionWe’re Hiring: Data Operations LeadShift: 10:00 AM – 07:00 PM ISTPositions: 1 | Type: Full-TimeWhat You’ll Be Doing:● Lead and manage the Data Operations team responsible for data collection, enrichment,validation, and delivery.● Implement and monitor data quality metrics, identify discrepancies, and drive processimprovements.●...

  • Data Operations Lead

    3 weeks ago

    Jaipur, India PASO Co Full time

    Job description💼 We’re Hiring: Data Operations LeadShift: 10:00 AM – 07:00 PM ISTPositions: 1 | Type: Full-TimeWhat You’ll Be Doing:● Lead and manage the Data Operations team responsible for data collection, enrichment,validation, and delivery.● Implement and monitor data quality metrics, identify discrepancies, and drive processimprovements.●...