Data Engineer

1 week ago

Pune, Maharashtra, India hashxpert Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Description :


We are seeking a highly skilled and security-conscious System Security Engineer with deep expertise in designing, implementing, and securing scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage, and will be responsible for ingesting and processing real-time data from connected vehicles and IoT devices. This role demands a strong understanding of ETL/ELT workflows, data governance, and cloud-native security practices.

Key Responsibilities :

Data Pipeline Engineering :


- Design and implement scalable, fault-tolerant data pipelines using GCP services including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.

- Develop real-time ingestion frameworks to process data from IoT devices and connected vehicle systems.

- Optimize data flow performance and ensure high availability across distributed systems.

ETL/ELT Development :


- Build and maintain robust ETL/ELT workflows using Python, SQL, Apache Beam, and Spark.

- Automate data transformation processes and integrate with downstream analytics platforms.

- Ensure modular, reusable, and testable code for data operations.

Security & Governance :


- Implement security controls across data pipelines, including IAM policies, encryption, and secure API integrations.

- Monitor and enforce data quality, lineage, and governance standards in the data lake.

- Collaborate with InfoSec teams to align with compliance frameworks such as ISO 27001, NIST, and GDPR.

DevOps & CI/CD :

- Integrate data workflows with CI/CD pipelines using tools like Jenkins, GitHub Actions, or Cloud Build.

- Manage deployment automation and rollback strategies for data infrastructure.

- Maintain version control and environment consistency across dev, test, and production.

Monitoring & Troubleshooting :


- Set up alerting and monitoring using Stackdriver, Prometheus, or equivalent tools.

- Troubleshoot pipeline failures, latency issues, and data anomalies.

- Conduct root cause analysis and implement preventive measures.

Required Skills & Qualifications :


- Bachelors or Masters degree in Computer Science, Information Security, or related field.

- 5 years of experience in cloud-based data engineering and security.

- Strong proficiency in Python, SQL, and GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage).

- Experience with Apache Beam, Spark, and Airflow.

- Familiarity with API integration, CI/CD practices, and infrastructure-as-code (Terraform preferred).

- Knowledge of cloud security principles and data governance frameworks.

- Excellent problem-solving, communication, and documentation skills.

Preferred Certifications :


- Google Professional Data Engineer or Cloud Security Engineer

- Certified Information Systems Security Professional (CISSP)

- ITIL Foundation or equivalent

  • Data Engineer with Power BI

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Business Consulting-Data Engineer with Power BI Req ID: 345385 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Business Consulting-Data Engineer with Power BI to join our team...

  • Data Scientist

    1 week ago

    Pune, Maharashtra, India Jash Data Sciences Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are a fast-growing startup based in Pune, India, specializing in cutting-edge Data Science and Data Engineering solutions. Our team of dedicated professionals is committed to solving complex data challenges for companies worldwide.Our CultureWe foster a vibrant startup culture that values:Intellectual curiosityContinuous learningPositive work...

  • Data Science Specialist

    6 days ago

    Pune, Maharashtra, India Data Direct Networks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    OverviewThis is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to...

  • Data Scientist Specialist

    8 hours ago

    Pune, Maharashtra, India Optimum Data Analytics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Data Scientist Specialist to join our growing AI & Data team. The ideal candidate will have hands-on experience designing and deploying AI/ML solutions with Azure Cloud, LLMOps, Containerized environments, and Generative AI technologies. This is an onsite role based in Pune, offering you the opportunity to collaborate...

  • Senior Software Engineer

    2 weeks ago

    Pune, Maharashtra, India Crest Data Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    We are looking for a strong ReactJS Lead Engineers to join our engineering team in Ahmedabad. The primary responsibility will be to lead the design and develop Enterprise Software for our Global Fortune 500 clients in Data Center and Big Data segments.Location: PUNE / AHMEDABAD ( WFO Only)Key ResponsibilitiesResponsible for providing expertise in software...

  • Senior Software Engineer

    1 week ago

    Pune, Maharashtra, India Data Axle Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Data Axle:Data Axle Inc. has been an industry leader in data, marketing solutions, sales and research for 50 years in the US. Data Axle has set up a strategic global centre of excellence in Pune. This centre delivers mission critical data services to its global customers powered by its proprietary cloud-based technology platform and leveraging...

  • Customer Experience Engineer

    7 hours ago

    Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Hevo Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics. Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...

  • Azure Support Engineer

    4 days ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Req ID: 338755NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Azure Support Engineer - Digital Solution Consultant Sr. Analyst to join our team in Pune, Mahārāshtra (IN-MH), India...

  • Sr Quality Engineer

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 339009NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Quality Engineer to join our team in Pune, Mahārāshtra (IN-MH), India (IN). Senior Quality Engineer I Who we...

  • Data Engineer

    4 days ago

    Pune, Maharashtra, India RedPluto Analytics Private Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Company DescriptionRedPluto Analytics is a trusted partner in data science, data engineering, and data analytics. Our passionate team of professionals leverages data to drive efficiency, innovation, and strategic decision-making for businesses across various industries in India. Our services include Data Engineering, Cloud Transformations, Data Management,...