Coditas - Senior Data Engineer - Python/Apache Spark

2 weeks ago

Pune, India Coditas Technologies Pvt. Ltd. Full time

We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning.Build products in the data analytics space.Roles and Responsibilities :- Develop and manage robust ETL pipelines using Apache Spark (Scala).- Understand Spark concepts, performance optimization techniques, and governance tools.- Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform, and load data from various systems to the Enterprise Data Warehouse/Data Lake/Data Mesh hosted on AWS or Azure.- Collaborate cross-functionally to design effective data solutions.- Implement data workflows utilizing AWS Step Functions or Azure Logic Apps for efficient orchestration.- Monitor, troubleshoot, and optimize pipeline performance and data quality.- Maintain high coding standards and produce thorough documentation.- Contribute to high-level (HLD) and low-level (LLD) design discussions.Technical Skills :- Minimum 7 years of progressive experience building solutions in Big Data environments.- Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant, and reliable in terms of data movement.- 3+ years of hands-on expertise in Python, Spark, and Kafka.- Strong command of AWS or Azure services.- Strong hands-on capabilities on SQL and NoSQL technologies.- Sound understanding of data warehousing, modeling, and ETL concepts.- Familiarity with High-Level Design (HLD) and Low-Level Design (LLD) principles.- Excellent written and verbal communication skills. (ref:hirist.tech)

  • Coditas - Senior Data Engineer - Python

    2 weeks ago

    Pune, India Coditas Technologies Pvt. Ltd. Full time

    Roles and Responsibilities :- Understand Business requirements and implement scalable solutions.- Translate complex technical and functional requirements into detailed designs.- Develop a highly scalable, reliable, and high-performance data processing pipeline to.- Extract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    7 days ago

    Pune, Maharashtra, India Coditas Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space.Roles and Responsibilities● Develop and manage robust ETL pipelines using Apache Spark (Scala)● Understand Spark concepts, performance optimization techniques, and governance...

  • Senior Cloudera Developer

    1 week ago

    Pune, India Deutsche Telekom Full time

    Your Role :We are looking for a Senior Cloudera Developer (Data Engineer) with extensive experience in Spark, the Hadoop ecosystem, and GCP services to design and implement data :- Design, develop, and implement data solutions using Cloudera technologies such as Hadoop, Spark, and Hive.- Collaborate with data engineers to optimize data pipelines and data...

  • Senior Data Engineer

    2 weeks ago

    pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...

  • Senior data engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior data engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...