Lead Data Engineer

1 day ago

India Cochin Kochi Ernakulam Velodata Global Pvt Ltd Full time

Job Description Job Title: Lead Data Engineer Location: Kochi / Trivandrum Experience: 10+ years Notice Period: Immediate to 15 days Budget: Up to 23 LPA Primary Skills - Core: AWS, Python Job Overview Seeking an experienced Senior/Lead Data Engineer to design and implement scalable data ingestion frameworks, ensure data quality and validation, and build robust APIs for seamless data integration. The ideal candidate will have hands-on expertise with AWS-based big data pipelines, automation, and high-performance API development. Key Responsibilities - Data Ingestion Framework: - Architect and maintain ETL pipelines using AWS Glue, Lambda, EMR, ECS, EC2, Step Functions. - Optimize data ingestion for scalability, resiliency, and automation. - Data Quality & Validation: - Build automated validation and error-handling mechanisms. - Implement monitoring, logging, and alerting for data quality assurance. - API Development: - Design and develop secure RESTful APIs for internal/external data integration. - Maintain API documentation and ensure adherence to best practices. - Collaboration & Agile: - Partner with business stakeholders, data scientists, and operations. - Contribute to CI/CD pipelines (preferably GitLab) and Agile processes. Required Qualifications - Experience: Minimum 5+ years in data engineering / analytical platform development. - Programming: Strong in Python / PySpark / SQL for ETL and large-scale data handling. - AWS Expertise: Hands-on with AWS Glue, Lambda, Step Functions, S3, and data platforms (EMR, Apache Spark, Iceberg). - Database Exposure: DynamoDB, Aurora, Postgres, Redshift. - API Development: Proven REST API design & integration skills. - DevOps: Experience with GitLab CI/CD, Agile methodology. Preferred Qualifications - Bachelor's/Master's in Computer Science, Data Engineering, or related field. - Familiarity with AWS Kinesis, Firehose, SQS, and data lakehouse architectures. - Experience with data quality frameworks and API-driven integrations in multi-cluster setups. - Commitment to Information Security policies and best practices.

  • Principal Data Engineer

    6 days ago

    Cochin / Kochi / Ernakulam, India Gadgeon Smart Systems Full time

    Job Description We are seeking a Principal Data Engineer with over 10 years of experience. In this high-impact role, you will be responsible for defining and driving the data architecture strategy, guiding technical teams, and ensuring robust, scalable, and secure database systems that support business-critical applications. You will work autonomously and...

  • Technical Lead

    2 weeks ago

    India, Cochin / Kochi / Ernakulam LYM DATA LABS PRIVATE LIMITED Full time

    Job Description About Lymdata Labs Lymdata Labs Private Limited is a fast-growing technology company building scalable digital products, cloud solutions, and marketing systems for global businesses. We believe in building smart, shipping fast, and scaling efficiently. We're looking for a Technical Lead who can lead by exampleowning architecture, guiding...

  • Senior/Lead Data Engineer

    4 weeks ago

    India Eucloid Data Solutions Full time

    About The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...

  • Senior/lead data engineer

    4 weeks ago

    India Eucloid Data Solutions Full time

    About The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...

  • Data Engineer

    2 weeks ago

    India, Cochin / Kochi / Ernakulam NOV Full time

    Job Description Job Description This role is part of the Digital Technology Services team at NOV. As a Data Engineer, you'll support data and analytics initiatives by helping to build and maintain data pipelines, data infrastructure, and operationalize analytics applications. You'll have the opportunity to learn a wide variety of technologies and work...

  • Senior/Lead Data Engineer

    4 weeks ago

    India Eucloid Data Solutions Full time

    About The Role: Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to...

  • Senior/Lead Data Engineer

    4 weeks ago

    India Eucloid Data Solutions Full time

    About The Role:Eucloid is looking for a senior/ lead Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure on Databricks for our clients by participating in activities which may includestarting from up- stream and down-stream technology selection to designing...

  • Senior Data Engineer

    3 weeks ago

    India, Cochin / Kochi / Ernakulam Velodata Global Pvt Ltd Full time

    Job Description Lead Data Engineer Skills Mandatory- S3, Glue, Lambda, Step Function, Snowflake. Skills - Primary - PySpark, Snowflake. Skills - Good to have - Cassandra Total Experience - 7+ years ; Relevant Experience - 5+ years Work Location : Cochin/TVM Job Purpose Responsible for consulting for the client to understand their data needs and delivering...

  • Lead Data Engineer

    2 hours ago

    Cochin, Kerala, India Careersteer services private limited Full time ₹ 10,00,000 - ₹ 23,00,000 per year

    We are seeking a highly skilled Lead Data Engineer with strong hands-on experience in AWS, Python, and PySpark. The ideal candidate will design, develop, and manage scalable data pipelines and architectures, lead a team of data engineers, and ensure data availability, reliability, and performance to support analytics, reporting, and business intelligence...

  • Data Centre Network Engineer

    4 weeks ago

    India, Cochin / Kochi / Ernakulam Japheth LLP Full time

    Job Description Japheth LLP is hiring for a client in Kochi, India.. Your Mission as a Data Centre Network Engineer, you'll be the architect, deploying, maintaining, and supporting high-performance networks. Your focus will be on combining deep networking knowledge with hands-on expertise, specializing in NVIDIA switches. Key Responsibilities Include: -...