Data Engineer

4 days ago

Kolkata, India hashxpert Full time

Description : We are seeking a highly skilled and security-conscious System Security Engineer with deep expertise in designing, implementing, and securing scalable data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage, and will be responsible for ingesting and processing real-time data from connected vehicles and IoT devices. This role demands a strong understanding of ETL/ELT workflows, data governance, and cloud-native security practices.Key Responsibilities : Data Pipeline Engineering :- Design and implement scalable, fault-tolerant data pipelines using GCP services including BigQuery, Dataflow, Pub/Sub, and Cloud Storage.- Develop real-time ingestion frameworks to process data from IoT devices and connected vehicle systems.- Optimize data flow performance and ensure high availability across distributed systems.ETL/ELT Development :- Build and maintain robust ETL/ELT workflows using Python, SQL, Apache Beam, and Spark.- Automate data transformation processes and integrate with downstream analytics platforms.- Ensure modular, reusable, and testable code for data operations.Security & Governance :- Implement security controls across data pipelines, including IAM policies, encryption, and secure API integrations.- Monitor and enforce data quality, lineage, and governance standards in the data lake.- Collaborate with InfoSec teams to align with compliance frameworks such as ISO 27001, NIST, and GDPR.DevOps & CI/CD : - Integrate data workflows with CI/CD pipelines using tools like Jenkins, GitHub Actions, or Cloud Build.- Manage deployment automation and rollback strategies for data infrastructure.- Maintain version control and environment consistency across dev, test, and & Troubleshooting :- Set up alerting and monitoring using Stackdriver, Prometheus, or equivalent tools.- Troubleshoot pipeline failures, latency issues, and data anomalies.- Conduct root cause analysis and implement preventive measures.Required Skills & Qualifications : - Bachelors or Masters degree in Computer Science, Information Security, or related field.- 5+ years of experience in cloud-based data engineering and security.- Strong proficiency in Python, SQL, and GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage).- Experience with Apache Beam, Spark, and Airflow.- Familiarity with API integration, CI/CD practices, and infrastructure-as-code (Terraform preferred).- Knowledge of cloud security principles and data governance frameworks.- Excellent problem-solving, communication, and documentation skills.Preferred Certifications : - Google Professional Data Engineer or Cloud Security Engineer- Certified Information Systems Security Professional (CISSP)- ITIL Foundation or equivalent (ref:hirist.tech)

  • Lead Data Engineer

    2 weeks ago

    Greater Kolkata Area, India Eucloid Data Solutions Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job DescriptionEucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to...

  • Senior Engineer

    5 days ago

    Kolkata, West Bengal, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Networking...

  • Security Implementation Engineer

    5 days ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at NTT...

  • Data Engineer

    2 weeks ago

    Kolkata, West Bengal, India Nilasu Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Mandatory skill databricks + Python Overall Exp Years Databricks & Python years Location Kolkata , Vizag , Pune, Bangalore , Hyderabad ,Chennai , Coimbatore , Kochi , Delhi/NCR   JOBCODE Role : Data Engineer (Sr) The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust...

  • Data Engineer

    3 days ago

    Kolkata, West Bengal, India Workmates Core2cloud Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Role & responsibilitiesAbout the role:As a Junior/Senior Data Engineer, you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the organization.Architecting and designing complex data systems and...

  • Data Engineer

    2 weeks ago

    Kolkata, West Bengal, India Lexmark Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...

  • Data Engineer with Data Operations

    2 weeks ago

    Kolkata, West Bengal, India Adv Techminds Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data Engineer with Data OperationsExperience: 7+ Years Employment Type: Contract Duration: 6 Months (Extendable) Location: KolkataKey Responsibilities:Design, develop, and maintain robust data pipelines to support data integration from Oracle Flexcube and other data sources into the Cloudera Data Platform.Utilize Hadoop for efficient data...

  • Data Engineer

    4 weeks ago

    Kolkata, India Tata Consultancy Services Full time

    Job Title: Data Engineer Exp Range: 6- 15 Yrs Job Location: Pan India - TCS Location Job Description: Required skill Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica • Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables •...

  • Data Engineer

    3 weeks ago

    Kolkata, India Tata Consultancy Services Full time

    Job Title: Data Engineer Exp Range: 6- 15 Yrs Job Location: Pan India - TCS LocationJob Description:Required skill Azure Data Factory, Databricks, Delta Live Tables, Python, SQL, Terraform, YAML, Azure Services, Data Warehousing, CI/CD, Data Governance, Purview, Informatica• Strong proficiency in Azure Data Factory, Databricks, Delta Live Tables • Solid...

  • Data Engineer with Data Operations

    1 week ago

    Kolkata, West Bengal, India Adv Techminds Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Data Engineer with Data OperationsExperience: 5+ Years Employment Type: Contract Duration: 6 Months (Extendable) Location: KolkataKey Responsibilities:Design, develop, and maintain robust data pipelines to support data integration from Oracle Flexcube and other data sources into the Cloudera Data Platform.Utilize Hadoop for efficient data storage...