Data Engineer

1 week ago

Kolkata, India Webologix Ltd INC Full time
Job Position: AWS Data Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 4+ to 10+ Years

Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.

Key Responsibilities:

- Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.- Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.- Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.- Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.- Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.- SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.- Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.- Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.

Required Skills and Qualifications:

- Proven experience as a Data Engineer or similar role with a focus on AWS technologies.- Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.- Expertise in Python and PySpark for data processing and automation tasks.- Solid experience with SQL and PL/SQL for querying and managing relational databases.- Demonstrated ability to design and implement data pipelines and workflows.- Strong problem-solving skills and attention to detail.- Excellent communication and collaboration abilities.

Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field.

  • Data Engineer

    1 month ago

    Kolkata, West Bengal, India We Remote Devs (WRD) Full time

    Job Title: Data EngineerAbout the RoleWe Remote Devs (WRD) is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and applications.Key ResponsibilitiesDesign and develop scalable data architectures and systems to meet business...

  • Networking Managed Services Engineer-L2

    3 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    4 weeks ago

    Kolkata, India bizaccenknnect Full time

    Job Title : Data EngineerJob SummaryWe are seeking a highly skilled Data Engineer to join our team at bizaccenknnect. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as developing visualizations and reports to enable data-driven decision-making.Key Responsibilities- Design, build, and optimize...

  • Data Engineer

    4 weeks ago

    Kolkata, West Bengal, India We Remote Devs WRD Full time

    About the Role:We Remote Devs WRD is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop scalable data pipelines using modern data processing technologies.Collaborate...

  • Network Engineering Specialist

    3 weeks ago

    Kolkata, West Bengal, India NTT DATA Full time

    Job Description Make a difference with NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move...

  • Data Engineer

    1 month ago

    Kolkata, India bizaccenknnect Full time

    Job Title: Data EngineerJob Summary:At bizaccenknnect, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as developing visualizations and reports to enable data-driven decision-making.Key Responsibilities:- Design, build, and...

  • Network Security Engineer

    3 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Senior Team Lead

    3 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    1 month ago

    Kolkata, India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAEJob Location: Offshore (anywhere in India)Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs)Technical Skills:Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field.5 to 10...

  • MS Engineer, Unix

    5 months ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • MS Engineer, Unix

    3 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data engineer

    1 week ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    2 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    2 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    1 week ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Data Engineer

    20 hours ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Platform Support Engineer

    1 month ago

    Kolkata, West Bengal, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Platform Support Engineer (L3) to join our team at NTT DATA. As a key member of our support team, you will be responsible for providing exceptional customer service and technical support to our clients.Key ResponsibilitiesProvide technical support to users and administrators of our NTT platformContribute to the...