Data Engineer

7 days ago

Kolkata, West Bengal, India Sundew Full time
Job Description

Roles and Responsibilities:

- Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support ETL (Extract, Transform, Load) processes using tools like Apache Airflow, AWS Glue, or similar.
- Database Management: Design, optimize, and manage relational and NoSQL databases (such as MySQL, PostgreSQL, MongoDB, or Cassandra) to ensure high performance and scalability.
- SQL Development: Write advanced SQL queries, stored procedures, and functions to extract, transform, and analyze large datasets efficiently.
- Cloud Integration: Implement and manage data solutions on cloud platforms such as AWS, Azure, or Google Cloud, utilizing services like Redshift, BigQuery, or Snowflake.
- Data Warehousing: Contribute to the design and maintenance of data warehouses and data lakes to support analytics and BI requirements.
- Programming and Automation: Develop scripts and applications in Python or other programming languages to automate data processing tasks.
- Data Governance: Implement data quality checks, monitoring, and governance policies to ensure data accuracy, consistency, and security.
- Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data needs and translate them into technical solutions.
- Performance Optimization: Identify and resolve performance bottlenecks in data systems and optimize data storage and retrieval.
- Documentation: Maintain comprehensive documentation for data processes, pipelines, and infrastructure.
- Stay Current: Keep up-to-date with the latest trends and advancements in data engineering, big data technologies, and cloud services.

Required Skills and Qualifications:

- Education: Bachelors or Masters degree in Computer Science, Information Technology, Data Engineering, or a related field.

- Technical Skills:
- Proficiency in SQL and relational databases (PostgreSQL, MySQL, etc.).
- Experience with NoSQL databases (MongoDB, Cassandra, etc.).
- Strong programming skills in Python; familiarity with Java or Scala is a plus.
- Experience with data pipeline tools (Apache Airflow, Luigi, or similar).
- Expertise in cloud platforms (AWS, Azure, or Google Cloud) and data services (Redshift, BigQuery, Snowflake).
- Knowledge of big data tools like Apache Spark, Hadoop, or Kafka is a plus.

- Data Modeling: Experience in designing and maintaining data models for relational and non-relational databases.

- Analytical Skills: Strong analytical and problem-solving abilities with a focus on performance optimization and scalability.

- Soft Skills:
- Excellent verbal and written communication skills to convey technical concepts to non-technical stakeholders.
- Ability to work collaboratively in cross-functional teams.

- Certifications (Preferred): AWS Certified Data Analytics, Google Professional Data Engineer, or similar.
- Mindset: Eagerness to learn new technologies and adapt quickly in a fast-paced environment

  • Data Engineer

    2 weeks ago

    Kolkata, West Bengal, India Aiinhome Technology Private Limited Full time

    Job Title: Data Engineer - Multiple Specializations (AWS, Azure, PySpark)Locations: Preferable KolkataExperience: Minimum 2+ yearsAbout the Role:We are seeking skilled Data Engineers with expertise in the following technologies to join our team.1. AWS Data Engineer - along with Pyspark , Data bricks , SQL2. Azure Data Engineer - along with Pyspark , Data...

  • Security Implementation Engineer

    3 weeks ago

    Kolkata, West Bengal, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    4 weeks ago

    Kolkata, West Bengal, India UniHyr Full time

    Job Description :Responsibilities :- Design, develop, and enhance data pipelines for extracting, transforming, and loading (ETL) data from multiple sources into the data warehouse.- Write and maintain SQL scripts and queries for data manipulation, analysis, and reporting.- Utilize Python for automation, scripting, and advanced data processing.- Develop...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India UniHyr Full time

    Job Description :Responsibilities :- Design, develop, and enhance data pipelines for extracting, transforming, and loading (ETL) data from multiple sources into the data warehouse.- Write and maintain SQL scripts and queries for data manipulation, analysis, and reporting.- Utilize Python for automation, scripting, and advanced data processing.- Develop...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India Xcel Hire Management Solutions Full time

    Position : Data Engineer (Py-Spark)Experience : 5+ yearsLocation : Skills :- MUST HAVE: AWS, iceberg, glue, Athena, lambda, emr, SQL, Py-Spark- Python(Advance Should know about inheritance and Class)- Athena, Redshift, IAM iceberg, Apache Airflow, GitImportant :Data Engineer skills :- Data warehousing ( e.g redshift)- Fetch data from database ( PostgreSQL,...

  • Data Engineering Lead

    4 weeks ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience:10-15 years of experience in data engineering and AI Labs industryDemonstrated experience in leading and managing data engineering teamsProven track record of delivering complex data engineering projectsRoles and Responsibilities:Lead the design, development, and implementation of scalable and efficient data engineering solutionsManage and mentor...

  • Data Engineering Lead

    2 weeks ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience: 10-15 years of experience in data engineering and AI Labs industry Demonstrated experience in leading and managing data engineering teams Proven track record of delivering complex data engineering projects Roles and Responsibilities: Lead the design, development, and implementation of scalable and efficient data engineering solutions Manage and...

  • Data Engineering Lead

    3 weeks ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience: 10-15 years of experience in data engineering and AI Labs industry Demonstrated experience in leading and managing data engineering teams Proven track record of delivering complex data engineering projects Roles and Responsibilities: Lead the design, development, and implementation of scalable and efficient data engineering solutions Manage and...

  • Data Engineering Lead

    5 days ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience:- 10-15 years of experience in data engineering and AI Labs industry- Demonstrated experience in leading and managing data engineering teams- Proven track record of delivering complex data engineering projectsRoles and Responsibilities:- Lead the design, development, and implementation of scalable and efficient data engineering solutions- Manage...

  • Data Engineering Manager

    6 days ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    We are looking for a highly skilled Data Engineering Lead with a strong background in Data Intelligence, specifically focusing on Data warehouse and Data Mining. As a Data Engineering Lead at Adani, you will be responsible for overseeing the design, development, and implementation of data engineering solutions to support our AI initiatives. This role...

  • Data Engineering Lead

    3 days ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Job Description Summary: We are seeking an experienced data engineer with a strong background in AI Labs to lead our data engineering team. Roles and Responsibilities: Design, develop, and implement scalable and efficient data engineering solutions. Manage and mentor a team of data engineers, providing technical guidance and leadership. Collaborate with...

  • Data Engineering Lead

    3 weeks ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Experience:10-15 years of experience in data engineering and AI Labs industryDemonstrated experience in leading and managing data engineering teamsProven track record of delivering complex data engineering projectsRoles and Responsibilities:Lead the design, development, and implementation of scalable and efficient data engineering solutionsManage and mentor...

  • Data Engineering Lead

    2 weeks ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    Job Summary 10-15 years of experience in data engineering and AI Labs industry with a proven track record of delivering complex data engineering projects. Lead the design, development, and implementation of scalable and efficient data engineering solutions. Roles and Responsibilities Lead the design, development, and implementation of scalable and efficient...

  • Data Engineering Strategist

    4 days ago

    Kolkata, West Bengal, India Sirius Digitech Full time

    **Job Overview:**Sirius Digitech is seeking an experienced Data Engineering Lead to lead our data engineering team in designing, developing, and implementing scalable and efficient data engineering solutions. The ideal candidate will have a strong leadership background, excellent communication skills, and a proven track record of delivering complex data...

  • Senior Data Engineer

    4 weeks ago

    Kolkata, West Bengal, India FinArb Consulting Full time

    Senior Data Engineer We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Key Responsibilities: Design, build, and maintain scalable data pipelines and workflows. Develop and optimize data ingestion, transformation, and integration processes. Work with Azure Data Factory and related technologies to build...

  • Senior Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India FinArb Consulting Full time

    Senior Data Engineer We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Key Responsibilities: Design, build, and maintain scalable data pipelines and workflows. Develop and optimize data ingestion, transformation, and integration processes. Work with Azure Data Factory and related technologies to build...

  • Senior Data Engineer

    4 weeks ago

    Kolkata, West Bengal, India FinArb Consulting Full time

    Job Title: Senior Data Engineer Responsibilities: We are seeking a self-driven Senior Data Engineer to join our dynamic team of data and software engineers. Your primary responsibilities will include: Designing, building, and maintaining scalable data pipelines and workflows. Developing and optimizing data ingestion, transformation, and integration...

  • Azure Data Engineer

    4 days ago

    Kolkata, West Bengal, India TGS The Global Skills Full time

    Job Summary : We are looking for an experienced Data Engineer with expertise in Azure Data Services to join our team in Kolkata. The ideal candidate should have strong data engineering skills, experience in Azure DevOps, PowerApps, and AI/ML services, along with a deep understanding of ETL, data modeling, and warehousing. Key Responsibilities : - Design,...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India Covenant Consultants Full time

    Company OverviewThis is for a fast-growing data and analytics consulting firm that partners with Fortune 500 companies across diverse industries to solve complex business challenges through data-driven insights. Their mission is to help organisations make smarter decisions by turning data into a strategic asset, enabling them to improve operations, boost...

  • Data Engineer

    3 weeks ago

    Kolkata, West Bengal, India Covenant Consultants Full time

    Company OverviewThis is for a fast-growing data and analytics consulting firm that partners with Fortune 500 companies across diverse industries to solve complex business challenges through data-driven insights. Their mission is to help organizations make smarter decisions by turning data into a strategic asset, enabling them to improve operations, boost...