AWS Data Engineer

4 months ago

West Bengal, India Webologix Ltd INC Full time

Job Position: AWS Data Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 4+ to 10+ Years

Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.


Key Responsibilities:


  • Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
  • Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
  • Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
  • Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
  • Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
  • SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
  • Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
  • Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.


Required Skills and Qualifications:

  • Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
  • Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
  • Expertise in Python and PySpark for data processing and automation tasks.
  • Solid experience with SQL and PL/SQL for querying and managing relational databases.
  • Demonstrated ability to design and implement data pipelines and workflows.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.


Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field.

  • Data engineer

    2 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Data Engineer

    2 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Data Engineer

    2 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities: Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. Develop and manage...

  • Data Engineer

    2 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities:Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...

  • Data engineer

    2 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue,...

  • Webologix Ltd/ INC | Data Engineer

    7 days ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Webologix Ltd/ INC | Data Engineer

    1 month ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...

  • Webologix Ltd/ INC | Data Engineer | west bengal

    2 months ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step...

  • Tata Consultancy Services | AWS Devops Engineer walkin interview

    1 week ago

    west bengal, India Tata Consultancy Services Full time

    Inviting application for AWS Devops Engineer RoleMode : Face to face walkin InterviewDate : 11-JAN-25Experience: 4+ yearsVenue: Tata Consultancy Services Gitanjali Park, International Finalcial Hub(CBD), Newtown, Kolkata, Chakpachuria, West Bengal 700156- HR Contact – Somnath YadavJob Description:Role : DevOps EngineerRequired Technical Skill Set AWS...

  • Data engineer

    2 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest,...

  • Networking Managed Services Engineer-l2

    2 months ago

    Kolkata, West Bengal, India NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Senior data engineer

    2 months ago

    Coimbatore West, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience in Data Bricks Engineer Along with any cloud experience. Experience Required: 7- 14 Years Location: Coimbatore, Tamil Nadu, India Responsibilities Design, develop, and optimize data workflows and notebooks using Databricks to ingest, transform, and load data from various sources into the data lake....

  • Nlp Data Scientist

    5 days ago

    Kolkata, West Bengal, India UST Global Full time

    3 - 5 Years - 1 Opening - Kolkata **Role description**: - **Business Analysis & Solution Design**: - Engage with business SMEs to gather requirements and translate them into technical specifications. - Design end-to-end solution workflows for AI/ML, NLP, and analytics use cases. - Define project requirements, including milestones, phases, and...

  • Amazon Web Services

    6 days ago

    Rajarhat, Kolkata, West Bengal, India Idenisys IT Consulting Full time

    **Responsibilities**: - Participate in planning, implementation, and growth of the infrastructure on Amazon Web Services (AWS) Cloud. - Work with the larger design team to develop a full Hybrid Cloud Solution. - Work closely with the architect and engineers to design networks, systems, and storage environment that effectively reflect business needs,...

  • Senior Full Stack Developer

    2 months ago

    west bengal, India Zuchiz Full time

    o Please apply if you are willing to work at our Bangalore office for 2 months, followed by a hybrid model based in Kolkata.o Be part of our team operating in stealth mode before our product launch in Octobero An attractive compensation based on professional background and skills.o Accommodation and meals will be taken care during your stay.o Join us now and...

  • Senior Full Stack Developer

    4 months ago

    west bengal, India Zuchiz Full time

    o Please apply if you are willing to work at our Bangalore office for 2 months, followed by a hybrid model based in Kolkata.o Be part of our team operating in stealth mode before our product launch in Octobero An attractive compensation based on professional background and skills.o Accommodation and meals will be taken care during your stay.o Join us now and...

  • Cloud Engineer

    4 months ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: GCP Cloud Database EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3-12 YearsMust Have: - GCP Cloud SQL; DataPro; Dataflow; Big Query, Big Table; Py Spark; Python.Responsibilities: Architecture Design:Design and implement robust OLTP database architectures that support high availability, scalability, and...

  • Zuchiz | Senior Full Stack Developer

    5 days ago

    west bengal, India Zuchiz Full time

    o Please apply if you are willing to work at our Bangalore office for 2 months, followed by a hybrid model based in Kolkata.o Be part of our team operating in stealth mode before our product launch in Octobero An attractive compensation based on professional background and skills.o Accommodation and meals will be taken care during your stay.o Join us now and...

  • Deloitte | Machine Learning Engineer | west bengal

    2 months ago

    west bengal, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as ML Ops Engineer .Experience Required: 5+ years.Location: Kolkata, West Bengal, IndiaResponsibilities:Model Deployment & Management:Design and implement end-to-end pipelines for deploying machine learning models into production environments.Ensure models are scalable and reliable and maintain...

  • Solution Architect

    2 months ago

    Kolkata, West Bengal, India NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...