AWS Data Engineer

1 month ago


Bangalore, Karnataka, India Quess Corp Ltd Full time

Exp Range : 6 - 10 years.

Primary Skills :

- Combination of Data Engineering (60%) and Database (40%) Developer.

- 3-4 years relevant exp in Data Engineering in AWS & DataBases in MongoDB, SQL Server.

- data engineering and DB developer.

- IDBI Good to have.

Shift Timing : 9AM to 6PM.

Working Model ( WFH / WFO / Hybrid )

Skills Required :


-Data Engineering (60%) : Proficiency in designing, building, and maintaining data pipelines and ETL processes.


- Experience with data ingestion, transformation, and storage on cloud platforms, especially AWS. Strong understanding of data warehousing concepts and methodologies.


- Familiarity with big data technologies such as Hadoop, Spark, or Kafka. Expertise in data modeling and schema design for optimized performance and scalability.


- Ability to troubleshoot and optimize data pipelines for efficiency and reliability.


- Knowledge of distributed computing and parallel processing frameworks.


Database Development (40%) :


- Experience in developing and optimizing databases, with a focus on MongoDB and SQL Server.


- Proficiency in writing complex SQL queries for data extraction, manipulation, and analysis.


- Understanding of database design principles, normalization, and indexing.


- Ability to fine-tune database performance and optimize query execution plans.


- Familiarity with database administration tasks such as backup and recovery, security, and monitoring. Experience with NoSQL databases like MongoDB, including data modeling and query optimization.


- Knowledge of best practices for database versioning, migrations, and change management.


Job Description :


- As an AWS Data Engineer, you will play a critical role in designing, implementing, and optimizing data solutions on the AWS platform.


- Your responsibilities will primarily revolve around data engineering tasks, with a focus on building robust data pipelines, ETL processes, and data warehousing solutions. Additionally, you will be involved in database development activities, particularly in optimizing MongoDB and SQL Server databases for performance and scalability.


Key Responsibilities :


Data Engineering :


- Design, develop, and maintain data pipelines for ingesting, transforming, and storing large volumes of data on AWS. Implement ETL processes to extract data from various sources, transform it according to business requirements, and load it into target systems.


- Collaborate with cross-functional teams to understand data requirements and design efficient data models and schemas. Troubleshoot and optimize data pipelines for performance, reliability, and scalability. Implement best practices for data governance, security, and compliance.


- Database Development : Develop and optimize MongoDB and SQL Server databases to support application requirements. Write and optimize complex SQL queries for data retrieval, manipulation, and analysis.


- Design and implement database schemas, ensuring data integrity, normalization, and efficient indexing. Perform database administration tasks such as backup and recovery, user management, and performance monitoring.


- Work closely with software developers to integrate database components into applications and ensure optimal performance.


Qualifications :


- Bachelor's or Master's degree in Computer Science, Engineering, or related field.


- 6-10 years of experience in data engineering and database development roles.


- At least 3-4 years of relevant experience in data engineering on AWS and database development with MongoDB and SQL Server.


- Strong programming skills in languages such as Python, Java, or Scala.


- Experience with AWS services such as S3, Glue, Redshift, EMR, and Lambda.


- Excellent problem-solving and analytical skills.


- Strong communication and collaboration abilities.

(ref:hirist.tech)

  • Bangalore, Karnataka, India BOOTLABS TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :- At least 3 years of experience in AWS technologies- The documented ability of delivering innovative solutions in an applied environment related to at least one of the following areas : ETL, Data pipeline, Workflow- Strong knowledge of programming in Python, Java, or Scala.- High level of competence in global and cross-skilled collaborative...

  • Data Engineer

    1 week ago


    Bangalore, Karnataka, India WIZSTAFFING PRIVATE LIMITED Full time

    Job Description :We at Captain Fresh, are building smart supply chain to deliver the highest quality seafood and meat for the Indian consumer.Our innovations in process management and workforce orchestration along with strong industry credentials are enabling us to deliver the fastest harvest-to-fork in the industry. Our endeavor is to leverage experience...


  • Bangalore, Karnataka, India BOOTLABS TECHNOLOGIES PRIVATE LIMITED Full time

    Responsibility :- At least 4 years of experience in AWS technologiesThe documented ability of delivering innovative solutions in an applied environment related to at least one of the following areas :- ETL, Data pipeline, Workflow- Strong knowledge of programming in Python, Java, or Scala.- High level of competence in global and cross-skilled collaborative...

  • Engineering Manager

    1 month ago


    Bangalore, Karnataka, India Connectio IT Pvt Ltd Full time

    Job Description :- Lead and mentor a team of software engineers, fostering a culture of innovation, collaboration, and continuous improvement. -Provide guidance and support to ensure team members meet their performance metrics and career development goals.- Oversee the planning, execution, and delivery of engineering projects, ensuring they are completed on...

  • DevOps Engineer

    3 weeks ago


    Bangalore, Karnataka, India MangoApps Full time

    About the job :MangoApps builds enterprise products that makes employees at organizations across the globe more effective and productive in their day-to-day work. We are looking for techpros, great communicators and collaborators and efficient team players for this role. This is your opportunity to be part of a rapidly growing organization and gain a deeper...

  • Data Engineer

    2 weeks ago


    Bangalore, Karnataka, India Recruise Full time

    Job Description :- AWS technologies such as S3, Redshift, Lambda, Athena,Glue, etc, Python, SQL- Bioinformatics or Life science experience Mandate- Programming experience with SQL and Python.- Strong Hands-on experience in built/deploy of end-to-end project.- Experience in ETL processing in AWS cloud, experience in works on orchestration tools preferably...

  • Data Engineer

    1 month ago


    Bangalore, Karnataka, India D Square Consulting Service Full time

    Role : Sr. Data Engineer DOMOExperience : 5+ YearsLocation : Bangalore- Candidates who can join within 30 days, may only applyWorking Mode : Work From OfficeJob Highlights :Must-Have skills :- 5+ years' experience in ELT systems (Snowflake and DOMO)- Must have experience in digital marketing projects.- Strong knowledge of digital marketing toolsPreferred...

  • Juego Studios

    3 weeks ago


    Bangalore, Karnataka, India Juego Studios Full time

    As a Python Data Engineer for Test at Client you will be at the forefront of ensuring the quality and reliability of our data systems. You will play a critical role in analyzing raw data, building test frameworks, and validating data products using Python. Collaborating closely with data analytics experts and stakeholders, you will contribute to the...

  • Engineering Manager

    1 month ago


    Bangalore, Karnataka, India Freelancer Recruiter Full time

    Mandatory requirements :- Apache Kafka- Elastic search- Spark Spring- NoSql- Swift- Distributed systems and Java (preferred)- Only from product organisationsResponsibilities : - Manage software development projects by setting requirements, goals and timelines. - Create clear career paths for team members and help them grow with regular & deep mentoring....

  • Data Squad Engineer

    1 month ago


    Bangalore, Karnataka, India Akshaya IT Business Solutions Full time

    Responsibilities : Develop and maintain data pipelines using PySpark for efficient data processing.Utilize AWS services, especially S3 for storage and data processing tasks.Manage data storage and retrieval using HDFS and Hive.Implement Spark for large-scale data processing and analytics.Work with both relational (MySQL) and non-relational (NoSQL) databases...


  • Bangalore, Karnataka, India Horigine Full time

    Job Description :We are looking for a skilled AWS Java Developer to join our dynamic and growing team. The ideal candidate will have a strong background in Java development and experience using Amazon Web Services. Responsibilities :- Design, develop, and implement Java applications to support business requirements.- Use AWS services to deploy and maintain...


  • Bangalore, Karnataka, India Pluralsight Full time

    Job Description : Working at Pluralsight Founded in 2004 and trusted by Fortune 500 companies, Pluralsight is the technology skills platform organizations and individuals in 150+ countries count on to create progress for the world. Our platform helps technologists master their craft and take control of their careers. We empower businesses everywhere to build...


  • Bangalore, Karnataka, India Transformhub Full time

    Required Experience & Skills :- 5+ years of previous experience as DevOps/ DevSecOps- Proficient knowledge working with AWS, Azure security- Hands-on experience with ECS, EKS, API gateway, RDS, S3, CloudWatch, CloudFormation, IAC, Code Pipeline, Code Build, Bitbucket- Proficient Unix, PowerShell knowledge- Degree in Computer Science, IT or other equivalent...

  • Python Developer

    1 month ago


    Bangalore, Karnataka, India IT Full time

    Job Overview :We are looking for a seasoned Python Developer with over 10 years of experience in IT, with a focus on data engineering. The ideal candidate will have extensive knowledge of Python, Pyspark, Azure Databricks, ADF, SQL, and data warehouse concepts. This role requires strong technical skills, project management capabilities, and excellent...


  • Bangalore, Karnataka, India Winning Edge Full time

    Job Description :8+ years of experience in industry performing software development4-year (bachelors) degree in computer science, software engineering, or similar fieldProficiency with Object Oriented Programming, multi-threading, data serialization and REST API to connect applications to back-end servicesExpertise in Docker and advanced containerization...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India GLAXOSMITHKLINE ASIA PVT. LTD Full time

    A new world-leading consumer health company. Shaped by all who join us. Together, we're improving everyday health for billions of people. By growing and innovating our global portfolio of category-leading brands including Sensodyne, Panadol, Advil, Voltaren, Theraflu, Otrivin, and Centrum through a unique combination of deep human understanding and...

  • Senior Data Architect

    1 month ago


    Bangalore, Karnataka, India HuQuo Consulting Pvt. Ltd. Full time

    Job Title : Senior Data ArchitectExperience : 10-15 yearsJob Description :We are seeking a highly skilled and experienced Senior Data Architect to join our dynamic team. The ideal candidate will play a crucial role in designing and implementing robust data solutions for our clients on cloud and on-premises platforms. As a Senior Data Architect, you will be...

  • Software Engineer

    1 month ago


    Bangalore, Karnataka, India IISC Full time

    - At IUDX, we are building an advanced state of the art HPC analytics processing engine. - The role involves developing a full stack analytic system including workflow/process graph compilations, workflow orchestration, distributed process execution, distributed file storage and system level performance optimization with TF/Torch/Cuda and other computing...

  • DevOps Engineer

    1 month ago


    Bangalore, Karnataka, India Corpxcel Consulting Full time

    Job Description :- Deploying/managing Kubernetes and Docker containers using only Infrastructure as Code and AWS. Kafka and API development as well. Event mesh engineerMust To Have (hands on) : - Kubernetes/Docker - CI/CD - Cloud (AWS or GCP) - REST API Development/Swagger - Event Streaming (Apache Kafka etc.) - minimum knowledge is fine. - Terraform,...

  • Data Scientist

    3 weeks ago


    Bangalore/Hyderabad, Karnataka, India Indium Software Full time

    Job Description:We are looking for a highly skilled and experienced Data Scientist to join our team. The ideal candidate should have a strong background in data science, with a focus on Natural Language Processing (NLP), Deep Learning, and experience working with AWS. Additionally, experience in implementing Gen AI solutions in projects is highly desirable....