Senior Data Engineer

4 weeks ago

Pune, India Coditas Technologies Full time

We are looking for data engineers who have the right attitude, aptitude, skills, empathy,

compassion, and hunger for learning. Build products in the data analytics space. A passion

for shipping high-quality data products, interest in the data products space; curiosity about

the bigger picture of building a company, product development and its people.

Roles and Responsibilities

  • Develop and manage robust ETL pipelines using Apache Spark (Scala)
  • Understand Spark concepts, performance optimization techniques, and governance tools
  • Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform, and load data from various systems to the Enterprise Data Warehouse/Data Lake/Data Mesh hosted on AWS or Azure
  • Collaborate cross-functionally to design effective data solutions
  • Implement data workflows utilizing AWS Step Functions or Azure Logic Apps for efficient orchestration. Leverage AWS Glue and Crawler or Azure Data Factory and Data Catalog for seamless data cataloging and automation
  • Monitor, troubleshoot, and optimize pipeline performance and data quality
  • Maintain high coding standards and produce thorough documentation. Contribute to high-level (HLD) and low-level (LLD) design discussions

Technical Skills

  • Minimum 6 years of progressive experience building solutions in Big Data environments
  • Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant, and reliable in terms of data movement
  • 3+ years of hands-on expertise in Python, Spark, and Kafka
  • Strong command of AWS or Azure services
  • Strong hands-on capabilities on SQL and NoSQL technologies
  • Sound understanding of data warehousing, modeling, and ETL concepts
  • Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles
  • Excellent written and verbal communication skills

  • Senior Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    4 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    23 hours ago

    Pune, Maharashtra, India Orcapod Consulting Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Senior Data EngineerSenior Data EngineersBuild and maintain data pipelines to support AI initiatives. Ensure data quality, integrity, and availability.Design and build ETL/ELT pipelinesSQL/NoSQL, Spark/Kafka, Airflow, ETL/ELT pipeline development; data governance, schema enforcementVector databases (Milvus, Pinecone), data lineage toolsDesign and build...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago

    pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...

  • Senior Data Engineer

    1 week ago

    Pune, India Dataceria Full time

    Company: Dataceria software solutions Pvt ltd.Job Position: Senior Data engineer _snowflakeLocation: PuneTimings to align with UK and USA timingsHybrid: 3 days in NT office PuneInterview stages: 1, initial screening, 2 stages client technical interviewStart date: asapDataceria is looking for a Senior Data Engineer to join our growing Data Delivery team.This...