Data Engineer

3 days ago


Kolkata, India s seth's assignment's Full time

Job Title: Data Engineer

Location: Remote 

Contract Terms: 3 Months with the potential to extend for more than a year


Overview

We are looking for a highly skilled and motivated Data Engineer with 4-8 years of experience to join our dynamic team. This role is ideal for individuals with advanced technical expertise in Python programming and relational databases, a strong background in data modeling and transformation, and the ability to process structured and unstructured data. The ideal candidate will thrive in a fast-paced, agile environment, collaborating effectively to develop features and solve complex problems.


Key Responsibilities
  • Design, develop, and maintain scalable data pipelines and systems.
  • Process and transform large datasets from various sources while ensuring data integrity and quality.
  • Build and optimize efficient queries for data retrieval and manipulation.
  • Collaborate with cross-functional teams to understand data requirements and deliver tailored solutions.
  • Implement robust data models and structures to support business intelligence and analytics.
  • Apply advanced Python programming techniques and leverage libraries like Pandas and NumPy to solve complex data challenges.
  • Utilize relational databases and ORMs (e.g., SQLAlchemy) effectively for data management.


Technical Skills
  • Python Programming (Advanced):
  • Comprehensive knowledge of syntax, semantics, multi-threading, multi-processing, regular expressions, and exception handling.
  • Expertise in libraries such as Pandas and NumPy.
  • ETL Pipelines:
  • Proficiency in designing and implementing ETL pipelines for large-scale data projects.
  • Object-Oriented Programming (OOP) (Intermediate):
  • Understanding of classes, objects, inheritance, polymorphism, and encapsulation.
  • Relational Databases (Advanced):
  • Experience in query optimization, query building, and managing databases such as PostgreSQL, MSSQL, and Oracle.
Expected Proficiency


  • AWS Cloud Services:
  • Familiarity with AWS tools relevant to data engineering, such as Athena and AWS Batch Jobs.
  • Data Modeling and Transformation:
  • Advanced expertise in processing structured and unstructured data.
  • Data Structures and Algorithms:
  • Proficient in manipulating arrays and lists, implementing searching and sorting algorithms.
  • Experience with recursion and analyzing time and space complexity.


Additional Skills and Experience


  • Familiarity with web frameworks such as Django or Flask.
  • Exposure to data science libraries like Scikit-learn, TensorFlow, or PyTorch.
  • Hands-on experience in big data projects and advanced data transformation techniques.


Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer or in a similar capacity.
  • Strong analytical and problem-solving skills.
  • Excellent communication and teamwork capabilities.




  • Kolkata, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...


  • Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Team Lead

    1 month ago


    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • MS Engineer, Unix

    1 month ago


    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    2 months ago


    Kolkata, India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAEJob Location: Offshore (anywhere in India)Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs)Technical Skills:Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field.5 to 10...

  • Data engineer

    3 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...


  • Kolkata, West Bengal, India NTT DATA Full time

    About the JobWe are seeking a highly skilled and experienced Cybersecurity Solutions Engineer to join our team at NTT DATA.Job DescriptionThe primary objective of this role is to ensure zero missed service level agreement (SLA) conditions and provide expert-level technical support to clients. The successful candidate will be responsible for managing tickets...

  • Data Engineer

    3 months ago


    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    4 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    4 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    4 months ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    3 months ago


    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    2 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data engineer

    3 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    4 weeks ago


    kolkata, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step Function Key Responsibilities: - Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB. - Build and maintain scalable ETL pipelines...

  • Data engineer

    3 weeks ago


    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data Engineer

    7 days ago


    Kolkata, West Bengal, India FinArb Consulting Full time

    Job TitleSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at FinArb Consulting. This is an exciting opportunity to work on large-scale data engineering projects, leveraging modern technologies to drive impactful insights.Key ResponsibilitiesDesign and build scalable data pipelines and workflows using...


  • Kolkata, India eInfochips (An Arrow Company) Full time

    Role: Senior Data EngineerYears of Experience: 5-10Location: Ahmedabad Overview:We are seeking a highly skilled and experienced Senior Software Engineer to join our Data Engineering team. The ideal candidate will have 5 to 10 years of experience in software engineering, with a strong focus on data engineering practices and an awareness of AI/ML and...