AWS Data Engineer

1 month ago

Bengaluru, India VY Systems Pvt Ltd. Full time

SALARY : 15LPA - 20LPA


Job Summary :


As a Data Engineer, you will be responsible for designing, developing, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. Leveraging your expertise in data engineering and software development, you will collaborate with cross-functional teams to build robust data solutions that enable efficient data processing, storage, and analysis. Your role will involve optimizing data workflows, ensuring data quality and integrity, and staying abreast of emerging technologies to continuously improve our data infrastructure.

Responsibilities :

1. Design, develop, and maintain scalable and efficient data pipelines to ingest, process, and store large volumes of structured and unstructured data.

2. Collaborate with data scientists, analysts, and other data engineers to understand data requirements and implement solutions that meet business needs.

3. Optimize data storage solutions, including relational databases, data lakes, and data warehouses.

4. Implement data governance practices to ensure data quality, consistency, and integrity across various data sources and pipelines.

5. Develop monitoring and alerting systems to proactively identify and address issues related to data pipeline performance, reliability, and security.

6. Automate repetitive tasks and streamline data workflows to improve efficiency and productivity.

7. Stay updated on industry trends and best practices in data engineering and recommend innovative solutions to enhance our data infrastructure.

8. Collaborate within the team to understand requirements and deliver high-quality solutions on time.

9. Participate in code reviews, testing, and deployment activities to ensure the reliability, scalability, and maintainability of data systems.

Qualifications :

1. Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

2. Minimum of 5 years of experience in data engineering, with a proven track record of designing and implementing complex data solutions.

3. Proficiency in programming languages such as Python, Java, or Scala, with experience in building and maintaining production-grade software applications.

4. Strong expertise in data processing frameworks and technologies, such as Apache Spark, Apache Flink, Hadoop, or similar.

5. Experience working with distributed computing systems and cloud-based data platforms, such as AWS, Google Cloud Platform, or Azure.

6. Solid understanding of database systems, SQL, and data modeling principles.

7. Familiarity with containerization technologies (e.g., Docker, Kubernetes) and microservices architecture.

8. Experience with version control systems (e.g., Git) and CI/CD pipelines.

9. Excellent problem-solving skills and attention to detail, with the ability to troubleshoot and debug complex data issues.

10. Strong communication and interpersonal skills, with the ability to collaborate effectively in a fast-paced, dynamic environment.

Preferred Qualifications :

1. Experience with real-time streaming data processing frameworks, such as Apache Kafka, Apache Flink, or similar.

2. Certification in cloud computing (e.g., AWS Certified Solutions Architect, Google Cloud Professional Data Engineer).

3. Experience with agile development methodologies and tools (e.g., Jira, Scrum).

4. Contributions to open-source projects or participation in data engineering communities.

Behavioral Skills :

1. Very good communication skills

2. Should be very interactive and top on deliverables being working from the client environment

(ref:hirist.tech)

  • AWS Data Engineer

    3 months ago

    Bengaluru, India Torry Harris Full time

    Are you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...

  • Sr Data Scientist, AWS Support Strategy Analytics and Data Science, Support Engineering

    3 months ago

    Bengaluru, India AWS India - Karnataka - D11 Full time

    AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, India Synechron Full time

    Job Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQLLocation: Pune/BangaloreExperience Required: 7+ yearsRole Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, India Synechron Full time

    Job Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQLLocation: Pune/BangaloreExperience Required: 7+ yearsRole Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data...

  • AWS Data Engineer

    6 days ago

    Bengaluru, India Synechron Full time

    Job Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQL Location: Pune/Bangalore Experience Required: 7+ years Role Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Acumant Full time

    Company DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • Data Engineer, Infra-Finance Business intelligence

    2 months ago

    Bengaluru, India AWS India - Karnataka Full time

    Do you have a desire to make a major contribution to the future in the rapid growth environment of Cloud Computing? Are you passionate about data and code? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process millions of records? Amazon Web Services is looking for a Data Engineer...

  • AWS Data Engineer

    5 days ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Acumant Full time

    Company Description Acumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Acumant Full time

    Company DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • Data Engineer

    3 weeks ago

    Bengaluru, India Acumant Full time

    Company DescriptionAcumant is a IT Services and Solutions company specializing in innovative and scalable data solutions and business applications. The company is dedicated to integrating sustainability, data, and AI solutions to empower organizations with cutting-edge technology. Acumant's focus is on driving businesses forward with tailored and...

  • AWS Data Engineer

    3 days ago

    Bengaluru, India NAM Info Inc Full time

    Job Title: AWS Data Engineer with PySparkLocation: Bangalore, ChennaiFulltimeJob Description:Preferred Skills and Qualifications:Proficient in AWS Cloud services and infrastructure.Strong experience with Databricks and PySpark.Extensive knowledge of data gathering ingestion, manipulation, orchestration, and optimization.Proven track record of leading...

  • AWS Data Engineer

    3 months ago

    Bengaluru, India EDGESOFT Full time

    Job Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and...

  • Data Engineer

    2 months ago

    Bengaluru, India Cayian India Pvt Limited Full time

    Cayian is a global IT and business service provider that delivers consultancy, capability, and system integration services to our partners. Our unique partner model is optimised to accelerate delivery, continuously improve quality, and drive business growth. Find out more about us here.  The role As a Data Engineer, you will be a part of...

  • AWS Data Engineer

    1 week ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • AWS Data Engineer

    6 days ago

    Bengaluru, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • Data Engineer

    3 months ago

    Bengaluru, India Spectrum Consulting Full time

    Position : Data Infrastructure EngineerCore work that needs accomplished :Architect, design and build Data access solution using various tool sets on Client's AWS and other platforms like DBT, Airflow, Atlan to enable clients data governance goalsThe solution will enable managing access to enterprise data at various layers of clients data solutions and...

  • Aws Cloud Architect

    2 months ago

    Bengaluru, India NTT DATA Full time

    **Req ID**: 248981 We are currently seeking a AWS Cloud Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Background As an Amazon Web Services (AWS) cloud architect, you will be responsible to architect and manage the cloud environment for a Digital Banking Asset. Duties include architecting and implementing cloud solutions,...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, India Birlasoft Full time

    About Birlasoft:Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla Group, a...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, India Birlasoft Full time

    About Birlasoft: Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CK Birla...