Data Engineer

5 days ago

Chennai, India hashxpert Full time

Description : We are seeking a highly skilled and security-conscious System Security Engineer with deep expertise in designing, implementing, and securing scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage, and will be responsible for ingesting and processing real-time data from connected vehicles and IoT devices. This role demands a strong understanding of ETL/ELT workflows, data governance, and cloud-native security practices.Key Responsibilities : Data Pipeline Engineering :- Design and implement scalable, fault-tolerant data pipelines using GCP services including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.- Develop real-time ingestion frameworks to process data from IoT devices and connected vehicle systems.- Optimize data flow performance and ensure high availability across distributed systems.ETL/ELT Development :- Build and maintain robust ETL/ELT workflows using Python, SQL, Apache Beam, and Spark.- Automate data transformation processes and integrate with downstream analytics platforms.- Ensure modular, reusable, and testable code for data operations.Security & Governance :- Implement security controls across data pipelines, including IAM policies, encryption, and secure API integrations.- Monitor and enforce data quality, lineage, and governance standards in the data lake.- Collaborate with InfoSec teams to align with compliance frameworks such as ISO 27001, NIST, and GDPR.DevOps & CI/CD : - Integrate data workflows with CI/CD pipelines using tools like Jenkins, GitHub Actions, or Cloud Build.- Manage deployment automation and rollback strategies for data infrastructure.- Maintain version control and environment consistency across dev, test, and & Troubleshooting :- Set up alerting and monitoring using Stackdriver, Prometheus, or equivalent tools.- Troubleshoot pipeline failures, latency issues, and data anomalies.- Conduct root cause analysis and implement preventive measures.Required Skills & Qualifications : - Bachelors or Masters degree in Computer Science, Information Security, or related field.- 5+ years of experience in cloud-based data engineering and security.- Strong proficiency in Python, SQL, and GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage).- Experience with Apache Beam, Spark, and Airflow.- Familiarity with API integration, CI/CD practices, and infrastructure-as-code (Terraform preferred).- Knowledge of cloud security principles and data governance frameworks.- Excellent problem-solving, communication, and documentation skills.Preferred Certifications : - Google Professional Data Engineer or Cloud Security Engineer- Certified Information Systems Security Professional (CISSP)- ITIL Foundation or equivalent (ref:hirist.tech)

  • Data Engineer

    2 weeks ago

    Chennai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Duties: As a data...

  • Data Engineer

    4 weeks ago

    Chennai, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities: ...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    4 weeks ago

    Chennai, India CX Data Labs Full time

    Hi Role - Azure Data engineer Location - Chennai, Gurugram (5days Onsite) Full time Immediate joiner Only (15days Notice period only) Technical Skills: o Proficiency in SQL for complex queries, database design, and optimization. o Strong experience with PySpark for data transformation and processing. o Hands-on experience with Databricks for building and...

  • Data Engineer

    4 weeks ago

    Chennai, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities: Design...

  • Senior data engineer

    7 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior data engineer

    6 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior data engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    2 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description Eucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...