Cloud Data Engineer

6 days ago


Kolkata, West Bengal, India Sundew Full time
About the Role

We are seeking an experienced Data Engineer to join our team at Sundew. As a Data Engineer, you will play a key role in designing, developing, and maintaining scalable data pipelines to support ETL processes using tools like Apache Airflow, AWS Glue, or similar. You will also be responsible for optimizing database performance, implementing data quality checks, and collaborating with data scientists, analysts, and business stakeholders to understand data needs and translate them into technical solutions.

Key Responsibilities

- Design and develop efficient data pipelines to extract, transform, and load large datasets efficiently.
- Optimize database performance by designing, optimizing, and managing relational and NoSQL databases (such as MySQL, PostgreSQL, MongoDB, or Cassandra).
- Develop advanced SQL queries, stored procedures, and functions to extract, transform, and analyze large datasets efficiently.
- Implement and manage data solutions on cloud platforms such as AWS, Azure, or Google Cloud, utilizing services like Redshift, BigQuery, or Snowflake.
- Contribute to the design and maintenance of data warehouses and data lakes to support analytics and BI requirements.
- Develop scripts and applications in Python or other programming languages to automate data processing tasks.
- Implement data quality checks, monitoring, and governance policies to ensure data accuracy, consistency, and security.
- Collaborate with data scientists, analysts, and business stakeholders to understand data needs and translate them into technical solutions.
- Identify and resolve performance bottlenecks in data systems and optimize data storage and retrieval.
- Maintain comprehensive documentation for data processes, pipelines, and infrastructure.

Requirements

- Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, or a related field.

- Technical Skills:
- Proficiency in SQL and relational databases (PostgreSQL, MySQL, etc.).
- Experience with NoSQL databases (MongoDB, Cassandra, etc.).
- Strong programming skills in Python; familiarity with Java or Scala is a plus.
- Experience with data pipeline tools (Apache Airflow, Luigi, or similar).
- Expertise in cloud platforms (AWS, Azure, or Google Cloud) and data services (Redshift, BigQuery, Snowflake).
- Knowledge of big data tools like Apache Spark, Hadoop, or Kafka is a plus.

- Analytical Skills: Strong analytical and problem-solving abilities with a focus on performance optimization and scalability.

- Soft Skills:
- Excellent verbal and written communication skills to convey technical concepts to non-technical stakeholders.
- Ability to work collaboratively in cross-functional teams.

- Certifications (Preferred): AWS Certified Data Analytics, Google Professional Data Engineer, or similar.

  • Kolkata, West Bengal, India Tata Consultancy Services Full time

    Explore the exciting role of a Cloud Data Engineer at Tata Consultancy Services. As a key member of our team, you will be responsible for designing, building, and maintaining large-scale data processing systems on cloud-based platforms.Company Overview: We are a leading IT services company that provides innovative solutions to businesses across the globe....

  • Data Engineer

    6 days ago


    Kolkata, West Bengal, India Sundew Full time

    Job DescriptionRoles and Responsibilities:- Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support ETL (Extract, Transform, Load) processes using tools like Apache Airflow, AWS Glue, or similar.- Database Management: Design, optimize, and manage relational and NoSQL databases (such as MySQL, PostgreSQL, MongoDB, or...

  • Data Engineer

    2 weeks ago


    Kolkata, West Bengal, India Aiinhome Technology Private Limited Full time

    Job Title: Data Engineer - Multiple Specializations (AWS, Azure, PySpark)Locations: Preferable KolkataExperience: Minimum 2+ yearsAbout the Role:We are seeking skilled Data Engineers with expertise in the following technologies to join our team.1. AWS Data Engineer - along with Pyspark , Data bricks , SQL2. Azure Data Engineer - along with Pyspark , Data...

  • Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India UniHyr Full time

    Job Description :Responsibilities :- Design, develop, and enhance data pipelines for extracting, transforming, and loading (ETL) data from multiple sources into the data warehouse.- Write and maintain SQL scripts and queries for data manipulation, analysis, and reporting.- Utilize Python for automation, scripting, and advanced data processing.- Develop...

  • Data Engineer

    4 weeks ago


    Kolkata, West Bengal, India UniHyr Full time

    Job Description :Responsibilities :- Design, develop, and enhance data pipelines for extracting, transforming, and loading (ETL) data from multiple sources into the data warehouse.- Write and maintain SQL scripts and queries for data manipulation, analysis, and reporting.- Utilize Python for automation, scripting, and advanced data processing.- Develop...

  • Azure Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India Indus Net Technologies Ltd Full time

    Job Titile: Azure Data EngineerJob Description:Sound skills and hands-on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for on-cloud ETL processing; copy activity, custom Azure development etc.Knowledge of Azure Data Catalog, Event Grid, Service Bus, SQL...

  • Data Engineering Lead

    2 weeks ago


    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience: 10-15 years of experience in data engineering and AI Labs industry Demonstrated experience in leading and managing data engineering teams Proven track record of delivering complex data engineering projects Roles and Responsibilities: Lead the design, development, and implementation of scalable and efficient data engineering solutions Manage and...

  • Data Engineering Lead

    2 weeks ago


    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience: 10-15 years of experience in data engineering and AI Labs industry Demonstrated experience in leading and managing data engineering teams Proven track record of delivering complex data engineering projects Roles and Responsibilities: Lead the design, development, and implementation of scalable and efficient data engineering solutions Manage and...

  • Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India Covenant Consultants Full time

    Company OverviewThis is for a fast-growing data and analytics consulting firm that partners with Fortune 500 companies across diverse industries to solve complex business challenges through data-driven insights. Their mission is to help organisations make smarter decisions by turning data into a strategic asset, enabling them to improve operations, boost...

  • Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India Covenant Consultants Full time

    Company OverviewThis is for a fast-growing data and analytics consulting firm that partners with Fortune 500 companies across diverse industries to solve complex business challenges through data-driven insights. Their mission is to help organizations make smarter decisions by turning data into a strategic asset, enabling them to improve operations, boost...


  • Kolkata, West Bengal, India Sirius Digitech Full time

    Experience:- 10-15 years of experience in data engineering and AI Labs industry- Demonstrated experience in leading and managing data engineering teams- Proven track record of delivering complex data engineering projectsRoles and Responsibilities:- Lead the design, development, and implementation of scalable and efficient data engineering solutions- Manage...


  • Kolkata, West Bengal, India Sirius Digitech Full time

    Job Description Summary: We are seeking an experienced data engineer with a strong background in AI Labs to lead our data engineering team. Roles and Responsibilities: Design, develop, and implement scalable and efficient data engineering solutions. Manage and mentor a team of data engineers, providing technical guidance and leadership. Collaborate with...

  • Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India Xcel Hire Management Solutions Full time

    Position : Data Engineer (Py-Spark)Experience : 5+ yearsLocation : Skills :- MUST HAVE: AWS, iceberg, glue, Athena, lambda, emr, SQL, Py-Spark- Python(Advance Should know about inheritance and Class)- Athena, Redshift, IAM iceberg, Apache Airflow, GitImportant :Data Engineer skills :- Data warehousing ( e.g redshift)- Fetch data from database ( PostgreSQL,...


  • Kolkata, West Bengal, India Sirius Digitech Full time

    Job Summary 10-15 years of experience in data engineering and AI Labs industry with a proven track record of delivering complex data engineering projects. Lead the design, development, and implementation of scalable and efficient data engineering solutions. Roles and Responsibilities Lead the design, development, and implementation of scalable and efficient...

  • Data Engineering Lead

    3 weeks ago


    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience:10-15 years of experience in data engineering and AI Labs industryDemonstrated experience in leading and managing data engineering teamsProven track record of delivering complex data engineering projectsRoles and Responsibilities:Lead the design, development, and implementation of scalable and efficient data engineering solutionsManage and mentor...


  • Kolkata, West Bengal, India Luxoft Full time

    Job DescriptionLuxoft is seeking a highly skilled Data Engineering Solutions Specialist to join our team. As a key member of our data engineering team, you will play a critical role in designing, developing, and maintaining complex data pipelines and ETL processes.ResponsibilitiesData Pipeline Development: Design, develop, and maintain efficient and scalable...


  • Kolkata, West Bengal, India Hyland Software Full time

    At Hyland Software, we are seeking a highly skilled DevOps Engineer to join our Cloud Operations team. This is an exciting opportunity to work with cutting-edge technologies and contribute to the development of our cloud infrastructure.About the RoleThe DevOps Engineer will be responsible for designing, implementing, and maintaining our cloud infrastructure,...

  • Senior Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India FinArb Consulting Full time

    Senior Data Engineer We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Key Responsibilities: Design, build, and maintain scalable data pipelines and workflows. Develop and optimize data ingestion, transformation, and integration processes. Work with Azure Data Factory and related technologies to build...

  • Senior Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India FinArb Consulting Full time

    Senior Data Engineer We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Key Responsibilities: Design, build, and maintain scalable data pipelines and workflows. Develop and optimize data ingestion, transformation, and integration processes. Work with Azure Data Factory and related technologies to build...


  • Kolkata, West Bengal, India IIMI Image Management Pvt. Ltd. Full time

    Company ProfileIIMI Image Management Pvt. Ltd. is a global leader in IT services, reimagining data processing through modern, cloud-based technology. With offices in multiple countries, we serve top clients like Fortune 500 companies in the US and Europe. Our team of over 7,000 employees worldwide shares a mission to advance data process automation.Job...