Data engineer

2 weeks ago

Kolkata, India Webologix Ltd INC Full time
Job Position: AWS Data Engineer
Job Type: Full-Time
Location: Kolkata, IN
Experience: - 4+ to 10+ Years
Must Have: -Amazon S3, Lambda, Glue, AWS Step Function, RDS, Dynamo DB, Python, Py Spark, SQL, PL/SQL.
Key Responsibilities:
Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and Py Spark. Ensure data is processed efficiently and accurately to meet business requirements.
Database Management: Manage and optimize relational and No SQL databases using Amazon RDS and Dynamo DB. Implement data models and design schemas to support business applications and reporting needs.
Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.
Required Skills and Qualifications:
Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and Dynamo DB.
Expertise in Python and Py Spark for data processing and automation tasks.
Solid experience with SQL and PL/SQL for querying and managing relational databases.
Demonstrated ability to design and implement data pipelines and workflows.
Strong problem-solving skills and attention to detail.
Excellent communication and collaboration abilities.
Qualifications:
Bachelor’s degree in computer science, Information Technology, or a related field.

  • Senior Data Integration Engineer

    8 hours ago

    Kolkata, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...

  • Data Engineer

    1 month ago

    Kolkata, West Bengal, India We Remote Devs (WRD) Full time

    Job Title: Data EngineerAbout the RoleWe Remote Devs (WRD) is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems and applications.Key ResponsibilitiesDesign and develop scalable data architectures and systems to meet business...

  • Data Engineer

    4 weeks ago

    Kolkata, India bizaccenknnect Full time

    Job Title : Data EngineerJob SummaryWe are seeking a highly skilled Data Engineer to join our team at bizaccenknnect. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as developing visualizations and reports to enable data-driven decision-making.Key Responsibilities- Design, build, and optimize...

  • Data Engineer

    4 weeks ago

    Kolkata, West Bengal, India We Remote Devs WRD Full time

    About the Role:We Remote Devs WRD is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data systems that support our business operations.Key Responsibilities:Design and develop scalable data pipelines using modern data processing technologies.Collaborate...

  • Data Engineer

    1 month ago

    Kolkata, India bizaccenknnect Full time

    Job Title: Data EngineerJob Summary:At bizaccenknnect, we are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines, as well as developing visualizations and reports to enable data-driven decision-making.Key Responsibilities:- Design, build, and...

  • Networking Managed Services Engineer-L2

    4 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Network Engineering Specialist

    3 weeks ago

    Kolkata, West Bengal, India NTT DATA Full time

    Job Description Make a difference with NTT DATANTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success. We invest over $3.6 billion each year in R&D to help organizations and society move...

  • Data Engineer

    2 months ago

    Kolkata, India Dautom Full time

    Role: Data Support Engineer Client: One of the leading banks in the UAEJob Location: Offshore (anywhere in India)Contract Duration: Minimum 6 months extendable contract (based on job performance and business needs)Technical Skills:Bachelor’s Degree in Computer Science, Information Technology, Data Science, Software Engineering, or a related field.5 to 10...

  • Network Security Engineer

    4 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data engineer

    2 weeks ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; Py Spark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Senior Team Lead

    4 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • MS Engineer, Unix

    5 months ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • MS Engineer, Unix

    3 weeks ago

    Kolkata, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineer

    2 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    2 months ago

    kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB Engineer Job Type: Full-Time Location: Kolkata, IN Experience: - 3 to 8+ Years Must Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; Python Responsibilities:  Data Pipeline Development: Design and implement data integration workflows using Azure Data Factory to ingest, transform, and...

  • Data Engineer

    3 months ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: Azure Cloud DB EngineerJob Type: Full-TimeLocation: Kolkata, INExperience: - 3 to 8+ YearsMust Have: - Azure DATA Factory; Azure SQL; Azure Databricks; Azure Cosmos DB; PySpark; PythonResponsibilities: Data Pipeline Development:Design and implement data integration workflows using Azure Data Factory to ingest, transform, and load data from...

  • Highly Skilled Cybersecurity Solutions Engineer

    8 hours ago

    Kolkata, West Bengal, India NTT DATA Full time

    About the JobWe are seeking a highly skilled and experienced Cybersecurity Solutions Engineer to join our team at NTT DATA.Job DescriptionThe primary objective of this role is to ensure zero missed service level agreement (SLA) conditions and provide expert-level technical support to clients. The successful candidate will be responsible for managing tickets...

  • Data Engineer

    4 days ago

    Kolkata, India Webologix Ltd INC Full time

    Job Position: AWS Cloud DB Engineer Job Type: Full-TimeLocation: Kolkata, INExperience: - 3+ to 10+ YearsMust Have: - Aws Glue; Aws Lambda; AWS RDS; AWS S3; Dynamo Db; PySpark; Python; AWS Step FunctionResponsibilities: Data Pipeline Development:Design and implement data ingestion and transformation workflows using AWS Glue.Develop and manage ETL...