Data Engineer

2 weeks ago

Pune, Maharashtra, India Programming Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Title : Data Engineer (GCP)

Location : Pune, Mumbai, Bangalore, Gurgaon, Panchkula, Mohali

Experience : 3+ years

Notice period : Immediate joiner

Job Description :

We are looking for a skilled and passionate Data Engineer with hands-on experience working on Google Cloud Platform (GCP). The ideal candidate will have expertise in building and maintaining data pipelines, utilizing GCP services, and implementing best practices for data ingestion, storage, and processing. If you have strong technical proficiency in Python or Java and enjoy solving complex challenges, we would love to hear from you

Key Responsibilities :

GCP Services :

- Design, develop, and manage data pipelines leveraging GCP services such as Google Cloud Storage (GCS), PubSub, Dataflow or DataProc, BigQuery, and Airflow/Composer.

- Work on Python (preferred) or Java-based solutions to build robust, scalable, and efficient data pipelines.

ETL on GCP Cloud :

- Develop and maintain ETL pipelines using Python/Java, ensuring data is processed efficiently and accurately.

- Write efficient scripts, adhere to best practices for data ingestion, transformation, and storage on GCP.

- Troubleshoot and solve data pipeline challenges, ensuring high performance and reliability.

Data Ingestion (Batch and Streaming) :

- Implement batch and streaming data ingestion workflows on GCP.

- Design, optimize, and monitor data pipelines for both batch processing and real-time streaming, ensuring smooth and seamless data flow.

Database Expertise :

- Knowledge of relational (SQL) and non-relational (NoSQL) databases both on-premise and in the cloud.

- Understanding the differences between SQL and NoSQL databases and experience working with at least two types of NoSQL databases.

- Expertise in working with databases on GCP, including BigQuery and others.

Data Warehouse Concepts :

- Apply your knowledge of data warehouse concepts to assist in designing efficient storage and processing solutions for large datasets.

- Familiarity with the principles of data warehousing, from data modeling to ETL processes, is required at a beginner to intermediate level.

Technical Skills Required :

GCP Services : GCS, PubSub, Dataflow, DataProc, BigQuery, Airflow/Composer | Programming : Python, Java | ETL Development : Data pipelines, Scripting | Data Ingestion : Batch, Streaming | Databases : SQL, NoSQL | Data Warehousing : Data Warehouse Concepts

  • Data Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary...

  • Data Engineer

    2 weeks ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Do you love solving real-world data problems with the latest and best techniques? And having fun while solving them in a team Then come join our high-energy team of passionate data people. Jash Data Sciences is the right place for you.We are a cutting-edge Data Sciences and Data Engineering startup based in Pune, India.We believe in continuous learning and...

  • Data Operations Engineer

    2 weeks ago

    Pune, Maharashtra, India Mars Data Insights Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Title: Data Operations Engineer & RUN SupportSkills:Data Operations Engineering, data manipulation, Python, Talend, GCP, Bigquery, DataIku, ITSM/ticketing tools, Helix, Jira, task management, data pipelines,  RUN Service, data infrastructure, data quality Job Location:Pune Job Type:Fulltime/Hybrid Work Experience:5+ years We are seeking a highly...

  • Business Consulting-Data Engineer with Power BI

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time

    Req ID: 345385NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team in Pune, Mahārāshtra (IN-MH), India (IN).Job...

  • Data Engineer with Power BI

    5 days ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Business Consulting-Data Engineer with Power BI Req ID: 345385 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team...

  • Data Scientist

    3 days ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are a fast-growing startup based in Pune, India, specializing in cutting-edge Data Science and Data Engineering solutions. Our team of dedicated professionals is committed to solving complex data challenges for companies worldwide.Our CultureWe foster a vibrant startup culture that values:Intellectual curiosityContinuous learningPositive work...

  • Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Data Axle Full time US$ 80,000 - US$ 1,20,000 per year

    Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging proprietary business &...

  • Senior Software Engineer

    5 days ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...

  • Senior Software Engineer

    3 days ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Senior QE Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 330974NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior QE Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I (JavaScript)...