Coditas - Senior Data Engineer - Python

2 weeks ago

Pune, India Coditas Technologies Pvt. Ltd. Full time

Roles and Responsibilities :- Understand Business requirements and implement scalable solutions.- Translate complex technical and functional requirements into detailed designs.- Develop a highly scalable, reliable, and high-performance data processing pipeline to.- Extract, transform and load data from various systems to the Enterprise Data warehouse/Data Lake/Data Mesh.- Provide research, high-level design and estimates for data transformation and data integration from source applications to end-use.- Investigate alternatives for data storing and processing to ensure implementation of the most streamlined solutions.- Develop comprehensive data products and implement them on cloud or in-house servers for production use. Technical Skills :- Minimum 6-10 years of progressive experience building solutions in Big Data environments.- Have a strong ability to build robust and resilient data pipelines which are scalable, fault tolerant and reliable in terms of data movement.- Hands-on experience of Apache Spark with Python for batch and stream processing.- Should have knowledge of experience in batch and stream data processing.- Exposure working on projects across multiple domains.- Strong hands on capabilities on SQL and NoSQL technologies.- Minimum 3+ years of experience with AWS services like S3, DMS, Redshift, Glue, Lambda, Kinesis, MSK etc. is must have or similar services of either Azure/GCP.- Strong analytical/quantitative skills and comfortable working with huge sets of data.- Excellent written and verbal communication skills. (ref:hirist.tech)

  • Coditas - Senior Data Engineer - Python/Apache Spark

    2 weeks ago

    Pune, India Coditas Technologies Pvt. Ltd. Full time

    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning.Build products in the data analytics space.Roles and Responsibilities :- Develop and manage robust ETL pipelines using Apache Spark (Scala).- Understand Spark concepts, performance optimization techniques, and governance...

  • Senior Data Engineer

    7 days ago

    Pune, Maharashtra, India Coditas Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    We are looking for Senior data engineers who have the right attitude, aptitude, skills, empathy, compassion, and hunger for learning. Build products in the data analytics space.Roles and Responsibilities● Develop and manage robust ETL pipelines using Apache Spark (Scala)● Understand Spark concepts, performance optimization techniques, and governance...

  • Senior Data Engineer

    2 weeks ago

    pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...

  • Senior data engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior data engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions.● Translate complex technical and functional requirements into detailed designs● Develop a highly scalable, reliable, and high-performance data processing pipeline toextract, transform and load data from various systems to the Enterprise Data warehouse/Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Coditas Full time

    Roles and Responsibilities ● Understand Business requirements and implement scalable solutions. ● Translate complex technical and functional requirements into detailed designs ● Develop a highly scalable, reliable, and high-performance data processing pipeline to extract, transform and load data from various systems to the Enterprise Data...