Data Engineer

3 days ago


Kolkata, West Bengal, India Webologix Ltd INC Full time
Job Description

We are seeking a highly skilled Data Engineer to join our team at Webologix Ltd. as an AWS Data Engineer.

About the Role

This is a full-time position located in Kolkata, IN. We require candidates with 4+ to 10+ years of experience in data engineering and a strong background in AWS technologies.

Key Responsibilities
  • Data Pipeline Development: Design and implement robust data pipelines using AWS services such as S3, Glue, Lambda, and Step Functions to facilitate ETL (Extract, Transform, Load) processes and ensure data integrity and accessibility.
  • Data Storage Management: Utilize Amazon S3 for scalable and secure data storage. Optimize data storage solutions and manage data lifecycle policies to ensure efficient data retrieval and cost management.
  • Data Transformation and Processing: Develop and execute data transformation workflows using AWS Glue and PySpark. Ensure data is processed efficiently and accurately to meet business requirements.
  • Database Management: Manage and optimize relational and NoSQL databases using Amazon RDS and DynamoDB. Implement data models and design schemas to support business applications and reporting needs.
  • Scripting and Automation: Write Python scripts to automate data processing tasks, integrate data from various sources, and develop custom solutions for data manipulation and analysis.
  • SQL and PL/SQL Development: Utilize SQL for querying relational databases and performing complex data manipulations. Apply PL/SQL for advanced database procedures and optimizations in Oracle environments.
  • Data Quality and Performance: Monitor and maintain data quality, performance, and security. Implement best practices for data management and troubleshoot issues to ensure reliable data operations.
  • Collaboration and Documentation: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and provide technical expertise. Document data pipelines, processes, and architecture to support ongoing maintenance and scalability.
Required Skills and Qualifications
  • Proven experience as a Data Engineer or similar role with a focus on AWS technologies.
  • Strong proficiency in AWS services including S3, Lambda, Glue, Step Functions, RDS, and DynamoDB.
  • Expertise in Python and PySpark for data processing and automation tasks.
  • Solid experience with SQL and PL/SQL for querying and managing relational databases.
  • Demonstrated ability to design and implement data pipelines and workflows.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration abilities.
Qualifications

Bachelor's degree in computer science, Information Technology, or a related field.


  • Data Engineer

    4 weeks ago


    Kolkata, West Bengal, India FinArb Consulting Full time

    Job TitleSenior Data EngineerAbout the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at FinArb Consulting. This is an exciting opportunity to work on large-scale data engineering projects, leveraging modern technologies to drive impactful insights.Key ResponsibilitiesDesign and build scalable data pipelines and workflows using...


  • Kolkata, West Bengal, India 2Coms Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at 2Coms. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining scalable and efficient data pipelines using tools like PySpark, Spark Scala, or Databricks.


  • Kolkata, West Bengal, India Risk Resources LLP Full time

    Data Engineering ProfessionalRisk Resources LLP is looking for a highly skilled data engineering professional to lead the development and maintenance of our data infrastructure.About the Position:Design and implement data pipelines, ETL processes, and data warehousesCollaborate with cross-functional teams to ensure data quality and integrityAnalyze and...


  • Kolkata, West Bengal, India Tredence Inc. Full time

    Tredence Inc. is a global leader in data science solutions, empowering businesses to unlock the full potential of their analytics investments.About UsWith a strong presence in San Jose, California, and offices in major cities worldwide, we deliver tailor-made solutions that bridge the gap between insight delivery and value realization.Our team of experts is...

  • Data Science Engineer

    2 weeks ago


    Kolkata, West Bengal, India SysTechCorp Inc Full time

    About the RoleAt SysTechCorp Inc, we are seeking a highly skilled Data Science Engineer to join our team. This is an exciting opportunity for a talented individual to work on cutting-edge projects and contribute to the growth of our organization.Key Responsibilities:Analyze large datasets to identify trends and patterns that can lead to actionable business...


  • Kolkata, West Bengal, India Wipro Full time

    At Wipro, we are seeking an experienced Senior Python Data Engineer to join our team. This is a challenging role that requires strong technical skills and the ability to work collaboratively with others.The estimated salary for this position is $120,000 - $180,000 per year, depending on location and experience.About UsWipro is a global information technology...

  • Software Engineer

    2 weeks ago


    Kolkata, West Bengal, India Wipro Full time

    We are seeking a highly skilled Software Engineer - Data Engineering and Analysis to join our team at Wipro. In this role, you will be responsible for designing, coding, testing, and working with product owners/Scrum Master for Scrum planning, estimation, demos, and leading/guiding junior developers.The ideal candidate will have 6-10 years of experience in...


  • Kolkata, West Bengal, India Wipro Full time

    About WiproWipro is a leading global information technology, consulting and business process services company.Job DescriptionWe are seeking an experienced Data Engineering Lead to join our team in this exciting role. As a key member of our engineering team, you will be responsible for designing, coding, testing, and working with product owners and scrum...


  • Kolkata, West Bengal, India Wipro Full time

    Wipro is seeking a seasoned professional to lead our data engineering team.About WiproWe are a global IT consulting and system integration service provider dedicated to helping our clients adapt to the digital world. Our mission is to empower businesses with cutting-edge technology and innovative solutions.Job DescriptionThis role will involve overseeing the...


  • Kolkata, West Bengal, India HARP Technologies and Services Full time

    Job Title: Cloud Data Engineering LeadLocation: Bangalore, Hyderabad, Pune, Mumbai, Noida, Chennai, KolkataSalary: ₹ 20-28 lakhs per annumAbout the RoleHARP Technologies and Services is seeking an experienced Cloud Data Engineering Lead to lead our cloud data engineering initiatives. As a key member of our team, you will be responsible for designing and...

  • Cloud Engineer

    1 week ago


    Kolkata, West Bengal, India Quess Corp Limited Full time

    Quess Corp Limited is seeking a highly skilled Cloud Engineer to join our team. As a Cloud Engineer, you will play a crucial role in designing and building scalable data pipelines using GCP services such as Dataflow, Pub/Sub, Cloud Functions, and Cloud Composer.The ideal candidate will have extensive experience with Google Cloud Platform (GCP) and its data...


  • Kolkata, West Bengal, India Wipro Full time

    Wipro is seeking a highly skilled Senior Data Engineering Specialist to join our team. As a key member of our organization, you will play a vital role in designing, developing, and maintaining complex data engineering solutions.Salary: $150,000 - $200,000 per annumIn this role, you will be responsible for working with product owners and scrum masters to plan...


  • Kolkata, West Bengal, India Webologix Ltd INC Full time

    Job Title:Senior Data Engineering LeadAbout the Role:We are seeking an experienced Senior Data Engineering Lead to join our team at Webologix Ltd. as a Technical Architect - OLTP DB.The successful candidate will be responsible for leading the design and implementation of scalable and high-performance OLTP database systems, developing data architecture...

  • Data Flow Engineer

    2 weeks ago


    Kolkata, West Bengal, India DigitalCube Consultancy Full time

    Job DescriptionWe are looking for a highly motivated Data Flow Engineer to join our team at DigitalCube Consultancy in Kolkata. As a permanent, full-time employee, you will report directly to the Head of IT Infrastructure.Key Responsibilities:- Design and implement integrations between business applications and platforms using APIs and other integration...

  • Senior Data Engineer

    3 weeks ago


    Kolkata, West Bengal, India Wipro Full time

    Job Description:Wipro is seeking a highly skilled Senior Data Engineer to join our team.About the Role:The successful candidate will be responsible for designing, coding, and testing data engineering solutions using Python. You will work closely with product owners and scrum masters to plan, estimate, and demonstrate project progress.Key Responsibilities:1....


  • Kolkata, West Bengal, India HARP Technologies and Services Full time

    Job Title: Large Scale Data Engineering LeadWe are hiring a Large Scale Data Engineering Lead to spearhead our big data initiatives at HARP Technologies and Services.This role requires a highly skilled professional with hands-on expertise in designing and building scalable data architectures using various databases, data warehousing, and business...


  • Kolkata, West Bengal, India HARP Technologies and Services Full time

    About Our TeamWe are a dynamic and supportive team at HARP Technologies and Services, committed to delivering high-quality solutions that meet the evolving needs of our clients.We are looking for a skilled Cloud Data Architect to join our team, responsible for designing and implementing large-scale data processing applications on Azure.The ideal candidate...


  • Kolkata, West Bengal, India Wipro Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineer with expertise in Python to join our team at Wipro. This is a challenging role that involves design, coding, and testing of complex data systems.About the RoleThis position requires a strong background in data engineering, analysis, and visualization using Python. The ideal candidate will...

  • Senior Cloud Engineer

    3 weeks ago


    Kolkata, West Bengal, India HTC Global Services Full time

    Job SummaryWe are seeking a highly skilled Senior Cloud Engineer to join our team at HTC Global Services. As a Senior Cloud Engineer, you will play a key role in designing and implementing data pipelines on Google Cloud Platform (GCP).About the RoleIn this position, you will work closely with our data engineering team to deliver high-quality software...


  • Kolkata, West Bengal, India Webologix Ltd INC Full time

    We are seeking an experienced Cloud Database Engineer and Data Architect to join our team at Webologix Ltd/ INC. In this role, you will design and implement scalable data pipelines using AWS Glue and develop serverless data processing workflows with AWS Lambda.Key Responsibilities:Design and implement data ingestion and transformation workflows using AWS...