Data Engineer

1 week ago

West Bengal, India Webologix Ltd INC Full time

Job Position: AWS Cloud DB Engineer

Job Type: Full-Time

Location: Kolkata, IN

Experience: - 3+ to 10+ Years

Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function

Responsibilities:

Data Pipeline Development:

  • Design and implement data ingestion and transformation workflows using AWS Glue.
  • Develop and manage ETL processes utilizing AWS Lambda for serverless data processing.

Database Management:

  • Deploy and maintain AWS RDS instances and DynamoDB tables, ensuring high availability, performance, and security.
  • Monitor and troubleshoot database performance issues and implement best practices for tuning and scaling.

Data Storage Solutions:

  • Utilize AWS S3 for data storage and retrieval, managing data lifecycle and access policies.
  • Develop efficient data models and storage strategies to support various analytics use cases.

Serverless Architecture:

  • Create and manage serverless workflows using AWS Step Functions to coordinate application components and data processes.
  • Write and maintain Python and PySpark scripts for data transformation and processing tasks.

Collaboration and Support:

  • Work closely with data analysts, data scientists, and application developers to support data-driven projects and initiatives.
  • Provide technical support for database-related issues and assist in troubleshooting data pipeline failures.

Best Practices and Security:

  • Implement data governance and security policies to ensure compliance with industry standards and best practices.
  • Stay current with emerging AWS technologies and best practices for database management and data engineering.


Qualifications:

Bachelor’s degree in computer science, Information Technology, or a related field.

  • Data Engineer

    2 weeks ago

    west bengal, India Pinnacle Infotech Full time

    Company Overview Pinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data Engineer

    1 week ago

    west bengal, India Pinnacle Infotech Full time

    Company Overview Pinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest,...

  • Data Engineer

    2 weeks ago

    west bengal, India Pinnacle Infotech Full time

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data Engineer

    1 week ago

    west bengal, India Pinnacle Infotech Full time

    Company OverviewPinnacle Infotech values inclusive growth in an agile, diverse environment. With 30+ years of global experience, 3,400+ experts completed 15,000+ projects across 43+ countries for 5,000+ clients. Join us for rapid advancement, cutting-edge training, and impactful global projects. Embrace E.A.R.T.H. values, celebrate uniqueness, and drive...

  • Data engineer

    3 days ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; Py Spark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Data Engineer

    1 week ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 4+ to 10+ YearsMust Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL.Key Responsibilities:Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to...

  • Data engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue,...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities:Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL processes...

  • Data Engineer

    1 week ago

    West Bengal, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3+ to 10+ Years Must Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step Function Responsibilities:  Data Pipeline Development: Design and implement data ingestion and transformation workflows using AWS Glue. ...

  • Azure data engineer

    2 months ago

    west bengal, India Tata Consultancy Services Full time

    Job Title- Databricks Developer Relevant Experience (in Yrs) 6 to 12 YRs Technical/Functi onal Skills · Minimum 5 years + working exp as Databricks Developer · Minimum 3 years + working exp on PySpark and AWS Experience Required 5 years+ Roles & Responsibilities · 5+ years relevant and progressive data engineering experience · Deep Technical knowledge...

  • Senior Data Engineer

    2 weeks ago

    west bengal, India Tredence Inc. Full time

    About Tredence: Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Senior Data Engineer

    3 weeks ago

    west bengal, India Tredence Inc. Full time

    About Tredence:Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from...

  • Networking Managed Services Engineer-l2

    3 weeks ago

    Kolkata, West Bengal, India NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Azure data engineer

    2 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database Engineer Experience Required: 3-15 Years Location: Kolkata Job Type: Full-time Must Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; Snowflake Key Responsibilities: - Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB. - Develop, optimize,...

  • Azure data engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:- Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB.- Develop, optimize, and automate...

  • Azure data engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: Azure Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python; SnowflakeKey Responsibilities:Design, implement, and manage cloud-based OLTP databases using Azure SQL and Azure Cosmos DB .Develop, optimize, and...

  • AWS Data Engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:- Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB.- Build and maintain scalable ETL pipelines using AWS Glue...

  • AWS Data Engineer

    3 weeks ago

    west bengal, India Webologix Ltd INC Full time

    Job Title: AWS Cloud Database EngineerExperience Required: 3-15 YearsLocation: KolkataJob Type: Full-timeMust Have: Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; Step FunctionKey Responsibilities:Design, develop, and manage cloud-based OLTP databases using AWS RDS and DynamoDB .Build and maintain scalable ETL pipelines using AWS...

  • AWS Data Engineer

    2 months ago

    west bengal, India Webologix Ltd INC Full time

    Job Position: AWS Data Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 4+ to 10+ Years Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, DynamoDB, Python, PySpark, SQL, PL/SQL. Key Responsibilities: Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step...