AWS Data Engineer

2 months ago

west bengal, India Webologix Ltd INC Full time

Job Position: AWS Data Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 4+ to 10+ Years

Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.


Key Responsibilities:


  • Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
  • Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
  • Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
  • Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
  • Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
  • SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
  • Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
  • Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.


Required Skills and Qualifications:

  • Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
  • Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
  • Expertise in Python and PySpark for data processing and automation tasks.
  • Solid experience with SQL and PL/SQL for querying and managing relational databases.
  • Demonstrated ability to design and implement data pipelines and workflows.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.


Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field.

  • AWS Data Engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...

  • AWS Data Engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB .Build and maintain scalable ETL pipelines using AWS...

  • AWS Data Engineer

    3 months ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data engineer

    3 days ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities:Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities: Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. Develop and manage...

  • Data Engineer

    1 week ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue,...

  • Data Engineer

    2 weeks ago

    west bengal, India Pinnacle Infotech Full time

    Company Overview Pinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data Engineer

    1 week ago

    west bengal, India Pinnacle Infotech Full time

    Company Overview Pinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data Engineer

    2 weeks ago

    west bengal, India Pinnacle Infotech Full time

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data Engineer

    1 week ago

    west bengal, India Pinnacle Infotech Full time

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Azure data engineer

    2 months ago

    west bengal, India Tata Consultancy Services Full time

    Job Title- Databricks Developer Relevant Experience (in Yrs) 6 to 12 YRs Technical/Functi onal Skills · Minimum 5 years + working exp as Databricks Developer · Minimum 3 years + working exp on PySpark and AWS Experience Required 5 years+ Roles & Responsibilities · 5+ years relevant and progressive data engineering experience · Deep Technical knowledge...

  • Webologix Ltd/ INC | Data Engineer | west bengal

    1 week ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step...

  • Pyspark/Python Data Engineer

    3 weeks ago

    west bengal, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Big Data Developer

    1 week ago

    west bengal, India Tata Consultancy Servicess Full time

    Job Description Required Information Details 1 Role- OpenSearch Architect 2 Desired Experience Range- 10-12 3 Location of Requirement- Kolkata Desired Skills -Technical/Behavioral Must-Have Solution Designing & architecture, OpenSearch, Data Migration and Transformation, AWS Good-to-Have Solution Designing & architecture, OpenSearch, Data Migration and...

  • Data engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest,...

  • Big Data Developer

    1 week ago

    west bengal, India Tata Consultancy Servicess Full time

    Job DescriptionRequired Information Details1 Role- OpenSearch Architect2 Desired Experience Range- 10-123 Location of Requirement- KolkataDesired Skills -Technical/BehavioralMust-HaveSolution Designing & architecture, OpenSearch, Data Migration and Transformation, AWSGood-to-HaveSolution Designing & architecture, OpenSearch, Data Migration and...

  • Data migration specialist

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS/Azure-Data-Services Job Type: Full-Time Location: Kolkata, IN Experience: - 6+ to 8+ Years Must Have: - AWS-Data-Services, AWS cloud Database Must Have: OLTP DB Migration, Data Modeling, AWS DMS; AWS SCT; Azure DMA; SSMA; GCP DMS, SQL; Postgre SQL; Python; Oracle, Sybase, Postgre SQL, MS SQL Key Responsibilities OLTP...