Data Engineer

4 weeks ago

Pune, India Coditas Technologies Full time

We are looking for data engineers who have the right attitude, aptitude, skills, empathy,

compassion, and hunger for learning. Build products in the data analytics space. A passion

for shipping high-quality data products, interest in the data products space; curiosity about

the bigger picture of building a company, product development and its people.

Roles and Responsibilities

  • Develop and manage robust ETL pipelines using Apache Spark (Scala)
  • Understand park concepts, performance optimization techniques and governance tools
  • Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data Warehouse/Data Lake/Data Mesh
  • Collaborate cross-functionally to design effective data solutions
  • Implement data workflows utilizing AWS Step Functions for efficient orchestration. Leverage AWS Glue and Crawler for seamless data cataloging and automation
  • Monitor, troubleshoot, and optimize pipeline performance and data quality
  • Maintain high coding standards and produce thorough documentation. Contribute to high-level (HLD) and low-level (LLD) design discussions

Technical Skills

  • Minimum 3 years of progressive experience building solutions in Big Data environments.
  • Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement.
  • 3+ years of hands-on expertise in Python, Spark and Kafka.
  • Strong command of AWS services like EMR, Redshift, Step Functions, AWS Glue, and AWS Crawler.
  • Strong hands on capabilities on SQL and NoSQL technologies.
  • Sound understanding of data warehousing, modeling, and ETL concepts
  • Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles
  • Excellent written and verbal communication skills.

  • Data Engineer

    4 weeks ago

    Pune, India Data Axle Full time

    About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    4 weeks ago

    Pune, India Jash Data Sciences Full time

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you. We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India. We believe in continuous learning and...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Engineer

    4 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID 324612NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineer to join our team in Pune Mahxc4x81rxc4x81shtra IN-MH India IN Key Responsibilities Design and...

  • Data Operations Engineer

    4 weeks ago

    Pune, India Mars Data Insights Full time

    Title: Data Operations Engineer & RUN Support Skills: Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality  Job Location: Pune  Job Type: Fulltime/Hybrid  Work Experience: 5+ years  We are seeking a...

  • Azure Data Engineer

    7 days ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Data Architect

    1 week ago

    Pune, India NTT DATA Full time

    **Req ID**:229970 We are currently seeking a Data Architect to join our team in Pune, Mah\u0101r\u0101shtra (IN-MH), India (IN). **Technical Skill Sets (mandatory)**: - Must have significant level knowledge on implementing cloud data warehouses - Snowflake, AWS Redshift, Azure SQL Data Warehouse, or Google BigQuery experience considered - Must have...

  • Data Scientist

    5 days ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Mid Data Science

    2 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid Data Science & AIML, GenAI Lead/Engineer to join our team in Pune, Mahārāshtra (IN-MH),...