Data Engineer

2 weeks ago

Pune, Maharashtra, India Programming Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Title : Data Engineer (GCP)

Location : Pune, Mumbai, Bangalore, Gurgaon, Panchkula, Mohali

Experience : 3+ years

Notice period : Immediate joiner

Job Description :

We are looking for a skilled and passionate Data Engineer with hands-on experience working on Google Cloud Platform (GCP). The ideal candidate will have expertise in building and maintaining data pipelines, utilizing GCP services, and implementing best practices for data ingestion, storage, and processing. If you have strong technical proficiency in Python or Java and enjoy solving complex challenges, we would love to hear from you

Key Responsibilities :

GCP Services :

- Design, develop, and manage data pipelines leveraging GCP services such as Google Cloud Storage (GCS), PubSub, Dataflow or DataProc, BigQuery, and Airflow/Composer.

- Work on Python (preferred) or Java-based solutions to build robust, scalable, and efficient data pipelines.

ETL on GCP Cloud :

- Develop and maintain ETL pipelines using Python/Java, ensuring data is processed efficiently and accurately.

- Write efficient scripts, adhere to best practices for data ingestion, transformation, and storage on GCP.

- Troubleshoot and solve data pipeline challenges, ensuring high performance and reliability.

Data Ingestion (Batch and Streaming) :

- Implement batch and streaming data ingestion workflows on GCP.

- Design, optimize, and monitor data pipelines for both batch processing and real-time streaming, ensuring smooth and seamless data flow.

Database Expertise :

- Knowledge of relational (SQL) and non-relational (NoSQL) databases both on-premise and in the cloud.

- Understanding the differences between SQL and NoSQL databases and experience working with at least two types of NoSQL databases.

- Expertise in working with databases on GCP, including BigQuery and others.

Data Warehouse Concepts :

- Apply your knowledge of data warehouse concepts to assist in designing efficient storage and processing solutions for large datasets.

- Familiarity with the principles of data warehousing, from data modeling to ETL processes, is required at a beginner to intermediate level.

Technical Skills Required :

GCP Services : GCS, PubSub, Dataflow, DataProc, BigQuery, Airflow/Composer | Programming : Python, Java | ETL Development : Data pipelines, Scripting | Data Ingestion : Batch, Streaming | Databases : SQL, NoSQL | Data Warehousing : Data Warehouse Concepts

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Data Operations Engineer

    2 weeks ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time US$ 80,000 - US$ 1,20,000 per year

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Senior Software Engineer

    6 days ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...

  • Senior Software Engineer

    4 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Geetha Technology Solutions Full time ₹ 12,50,000 - ₹ 25,00,000 per year

    We are seeking a highly skilled and motivated Engineering Lead to join our team as a Cloud and Data Engineer. The ideal candidate will possess extensive expertise in cloud technologies and data engineering, with a proven ability to orchestrate cutting-edge technology to connect various applications within the cloud environment.Key Responsibilities:Lead the...

  • Data Engineer

    6 days ago

    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Assistant Manager - Data Engineer - PuneThe Assistant Manager - Data Engineer role in Pune involves working on data engineering projects and collaborating with cross-functional teams to develop and maintain data pipelines, ETL processes, and data warehousing solutions. The role requires strong analytical and problem-solving skills, as well as the ability to...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Nitor Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Hi ,Greetings from Nitor infotechWere Hiring: Senior Data Engineer (Big Data / GCP / Pyspark)Are you a seasoned Data Engineer who loves solving complex problems, building scalable data systems, and mentoring others?Were looking for a Senior Data Engineer to architect and lead the next generation of our data platforms. If you live and breathe Big Data, Cloud,...

  • Mid level GenAI Engineers

    6 days ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 10,00,000 - ₹ 30,00,000 per year

    Req ID: 341066NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid level GenAI Engineers to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Key Responsibilities Build...