Data Engineer

2 days ago

Pune, India Coders Brain Technology Private Limited Full time

Job Description :

We are looking for an experienced Data Engineer to join our team. The ideal candidate will have strong expertise in data engineering technologies and tools, with a focus on cloud platforms like AWS and Azure, along with data processing frameworks such as Databricks, Airflow, PySpark, and Python.

Key Responsibilities :

Data Pipeline Development :

- Design, develop, and maintain scalable data pipelines for ingestion, transformation, and storage.

- Utilize Databricks, Airflow, and PySpark to build high-performance data workflows.

Cloud Platform Expertise :

- Leverage AWS and Azure cloud services for data processing, storage, and analytics.

- Optimize and manage data lakes and warehouses for performance and cost-efficiency.

Data Integration and ETL :


- Implement ETL processes to integrate data from various sources into centralized systems.

- Ensure data quality, integrity, and consistency across pipelines.

Performance Optimization :


- Optimize data workflows and queries for performance improvements and reduced latency.

- Implement robust error handling and monitoring for data workflows.

Collaboration :


- Work closely with cross-functional teams, including Data Scientists, Analysts, and Business Stakeholders.

- Translate business requirements into technical solutions and data workflows.

Documentation and Reporting :


- Maintain comprehensive documentation of data workflows, pipelines, and systems.

- Provide insights and reporting on data performance and pipeline status.

Key Skills & Requirements :


Technical Expertise :


- Strong proficiency in AWS and Azure cloud platforms.

- Experience with Databricks, Airflow, PySpark, and Python.

- Hands-on experience with data modeling, transformation, and analytics.

Data Processing :


- Expertise in building scalable and reliable ETL/ELT workflows.

- Knowledge of big data tools and techniques for processing large datasets.

Performance Optimization :


- Experience in optimizing data workflows, queries, and cloud resource usage.

Soft Skills :


- Strong problem-solving and analytical abilities.

- Excellent communication skills to liaise with technical and non-technical stakeholders.

Preferred Qualifications :


- Experience with Snowflake, Redshift, or similar data warehouses.

- Familiarity with CI/CD pipelines for data workflows.

- Exposure to machine learning workflows and MLOps.

(ref:hirist.tech)

  • Senior Data Engineer

    7 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Analytics Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Dynamics Full time

    About Data Dynamics">Data Dynamics is a leading data-driven company that leverages cutting-edge technologies to drive business growth. Our team of experts collaborates with clients across various industries to deliver innovative solutions.Job Summary">We are seeking an experienced Senior Machine Learning Specialist to join our team. As a key member, you will...

  • Senior Data Protection Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Data Protection Engineer to join our team at NTT DATA. This is an exciting opportunity to work with a leading global innovator of business and technology services.Key Responsibilities:Implement and maintain data protection systems, ensuring high levels of security and efficiency.Configure and manage data...

  • Data Centre Backup Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    About the JobThis exciting opportunity is for a highly skilled Data Centre Backup Engineer to join our team at NTT DATA. As a key member of our data centre operations team, you will be responsible for driving best practices, innovation and process improvements across multiple data centre locations.Key Responsibilities include:Installation and configuration...

  • Principal Data Architect

    4 weeks ago

    Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...

  • Data Scientist

    6 months ago

    Pune, Maharashtra, India Data Dynamics Full time

    **Objectives of this role**: - Collaborate with product design and engineering teams to develop an understanding of needs. - Research and devise innovative statistical models for data analysis. - Build innovative models and integrate them in our product. - Communicate findings to all stakeholders. - Keep current with technical and industry...

  • Senior Data Scientist

    7 months ago

    Pune, India Data Axle Full time

    Job Description About Data Axle: Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology...

  • Data Scientist

    4 days ago

    Pune, Maharashtra, India Data Axle Full time

    **About Data Axle**: **Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for over 45 years in the USA. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by...

  • Data Safeguard Inc. | AI ML Engineer | pune

    1 month ago

    pune, India Data Safeguard Inc. Full time

    Company Overview: Data Safeguard is an esteemed leader in protecting clients' sensitive data, specializing in delivering advanced data privacy and synthetic fraud solutions. Trusted by top-tier organizations across various industries, we ensure compliance with data privacy regulations and mitigate financial risks associated with synthetic fraud. With a...

  • Data Safeguard Inc. | AI ML Engineer | pune

    1 month ago

    pune, India Data Safeguard Inc. Full time

    Company Overview: Data Safeguard is an esteemed leader in protecting clients' sensitive data, specializing in delivering advanced data privacy and synthetic fraud solutions. Trusted by top-tier organizations across various industries, we ensure compliance with data privacy regulations and mitigate financial risks associated with synthetic fraud. With a...

  • Digital Engineering Sr. Engineer

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Job TitleA Digital Engineering Sr. Engineer position is available at NTT DATA in Remote, India.About the RoleWe are seeking an experienced Digital Engineering Sr. Engineer to join our team. The ideal candidate will have a strong background in digital engineering and be able to work independently with minimal supervision.About the CompanyNTT DATA is a $30...

  • Chief Data Governance Strategist

    3 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    About the RoleWe are seeking a Chief Data Governance Strategist to join our team in Pune, India. This role is responsible for leading our data management practice and implementing best practices in data governance, master data management, and data quality.Key Responsibilities:Develop and implement data governance policies and proceduresLead the development...

  • Data Governance Architect

    1 month ago

    Pune, Maharashtra, India NTT DATA Full time

    **Req ID**: 304038 We are currently seeking a Data Governance Architect to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Job Duties: Lead the data management practice that includes but not limited to - Data Governance/catalog - MDM - Data Quality - Testing Minimum Skills Required: Must have experience in data analysis, data engineering for 10+...

  • Data Scientist

    2 months ago

    Pune, India Data Dynamics Full time

    Objective of this role :- Collaborate with product design and engineering teams to develop an understanding of needs.- Research and devise innovative statistical models for data analysis.- Build innovative models and integrate them in our product.- Communicate findings to all stakeholders.- Keep current with technical and industry developments. Key...

  • Data Scientist

    2 weeks ago

    Pune, India Data Dynamics Full time

    Objective of this role :- Collaborate with product design and engineering teams to develop an understanding of needs.- Research and devise innovative statistical models for data analysis.- Build innovative models and integrate them in our product.- Communicate findings to all stakeholders.- Keep current with technical and industry developments. Key...

  • Data Scientist

    3 months ago

    Pune, Maharashtra, India Data Direct Networks Full time

    Overview: This is an incredible opportunity to be part of a company that has been at the forefront of AI and high performance data storage innovation for over two decades. DDN Storage is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare, to financial...

  • Digital Engineering Engineer

    4 weeks ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 295083 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job Duties:...

  • Associate Data Scientist

    6 months ago

    Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Associate Data Scientist

    6 months ago

    Pune, Maharashtra, India Data Axle Full time

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales, and research for over 50 years in the USA. Data Axle now has an established strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and by leveraging...

  • Digital Engineering Engineer

    1 month ago

    Pune, India NTT DATA Full time

    Job Description Req ID: 292804 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Digital Engineering Engineer to join our team in Pune, Mahārāshtra (IN-MH), India...