AWS Big Data Specialist

2 days ago


Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time
Job Description

In this role, you will be responsible for designing, developing, and deploying data pipelines using AWS services. You will also build and maintain data lakes and data warehouses on AWS, develop and implement data quality checks and monitoring systems, and troubleshoot and resolve data-related issues.

Responsibilities
  1. Data Pipeline Development: Design, develop, and deploy data pipelines using AWS services such as Glue, Lambda, S3, EMR, Kinesis, and Redshift.
  2. Data Lake and Warehouse Management: Build and maintain data lakes and data warehouses on AWS.
  3. Data Quality Checks: Develop and implement data quality checks and monitoring systems.
  4. Troubleshooting: Troubleshoot and resolve data-related issues.
  5. Collaboration: Collaborate with data scientists and analysts to understand business requirements and translate them into technical solutions.
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience as a Big Data Engineer or a similar role.
  • Strong experience with AWS services, including Glue, Lambda, S3, EMR, Kinesis, and Redshift.
  • Proficiency in Python and SQL.
  • Experience with data warehousing and data lake architectures.
Salary Range: $150,000 - $220,000 per annum
  • Big Data Engineer

    23 hours ago


    Pune, Maharashtra, India Capco Technologies Pvt Ltd Full time

    Job Title:Big Data Engineer - ETL SpecialistAbout Us:We are Capco Technologies Pvt Ltd, a leading technology firm.Salary:$120,000 - $180,000 per yearJob Description:As a Big Data Engineer - ETL Specialist, you will design, develop, and deploy data pipelines and ETL/ELT processes using AWS services such as AWS Glue, AWS Lambda, AWS S3, AWS EMR, AWS Kinesis,...


  • Pune, Maharashtra, India LTIMindtree Full time

    We are seeking a highly skilled Big Data Engineering Specialist to join our team at LTIMindtree. As a key member of our big data engineering team, you will be responsible for designing and developing scalable big data platforms using modern technologies like Scala Spark and Hadoop ecosystem.This role requires a deep understanding of modern data processing...


  • Pune, Maharashtra, India LTIMindtree Full time

    LTIMindtree is seeking a highly skilled Big Data Optimization Expert to join their team.Job Summary:We are looking for an experienced Big Data Specialist with expertise in Spark job optimizations, tuning, and resource utilization. The ideal candidate will have a strong understanding of OSS Delta Lake and Open Source Storage.About the Role:The successful...


  • Pune, Maharashtra, India Talentmatics Full time

    Talentmatics is seeking an experienced Big Data Platform Specialist to join our team in Pune or Hyderabad.Estimated Salary: ₹2,500,000 - ₹4,200,000 per annum.Job Description:We are looking for a skilled Hadoop administrator with 5-8 years of work experience to manage our Big Data platform and allied toolset. The ideal candidate should have strong...


  • Pune, Maharashtra, India Birlasoft Full time

    About BirlasoftBirlasoft is a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. Our consultative approach drives societal progress by enabling customers to run businesses with unmatched efficiency and innovation.We boast a 12,500+ professional team committed to upholding the Group's...


  • Pune, Maharashtra, India Talentmatics Full time

    Talentmatics is seeking an experienced Big Data Infrastructure Specialist to join our team in Pune and Hyderabad locations. This role offers a competitive salary of approximately ₹2,500,000 per annum.Job Description:We are looking for a skilled professional with 5-8 years of experience in administering big data platforms and allied toolsets. The ideal...


  • Pune, Maharashtra, India Synechron Full time

    Job Title: Senior Big Data EngineerEstimated Salary: ₹1,500,000 - ₹2,000,000 per annumAt Synechron, we are looking for a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have a solid understanding of big data technologies and be able to design and implement scalable data solutions using AWS services.About the Role:We are...


  • Pune, Maharashtra, India NTT DATA Full time

    Company OverviewNTT DATA is a global technology services company that helps clients innovate, optimize and transform for long term success. We have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies.Our Commitment to YouEstimated Salary: ₹2,200,000 - ₹3,500,000 per annum (dependent on...


  • Pune, Maharashtra, India Tata Consultancy Services Full time

    Tata Consultancy ServicesWe are seeking a highly skilled AWS Cloud Data Specialist to join our team. The successful candidate will have 5-8 years of experience in designing and implementing data pipelines, ETL processes, and data transformations using AWS services.The ideal candidate will possess in-depth knowledge of AWS components such as AMI Rehydration,...

  • Data Engineer

    2 weeks ago


    Pune, Maharashtra, India Genpact Full time

    About GenpactGenpact is a global professional services company that connects customers to a better future through digital transformation, business process outsourcing, and enterprise cloud applications. We help our clients create and deliver market breakthroughs by combining next-generation digital capabilities such as AI and analytics with deep domain...


  • Pune, Maharashtra, India LTIMindtree Full time

    About the Role">We are seeking a highly skilled Big Data Specialist to join our team at LTIMindtree. As a Big Data Expert, you will be responsible for driving business growth through data insights and optimization of big data processing.">Key Responsibilities">">Design and implement efficient big data processing pipelines using Spark and AWS EMR">Develop...


  • Pune, Maharashtra, India BlueByte Technologies Full time

    Data Engineer Job SummaryWe are seeking an experienced Data Engineer to join our team at BlueByte Technologies. As a seasoned professional, you will be responsible for developing, maintaining, and scaling our big data infrastructure.About the Role:Design, develop, and maintain end-to-end ETL/ELT pipelines in Snowflake, from raw data ingestion to...


  • Pune, Maharashtra, India Epam Full time

    EPAM is a leading global provider of digital platform engineering and development services.We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture.As a Senior Big Data Solutions Architect, you will play a crucial role in designing and implementing Big Data solutions for our...

  • Big Data Engineer

    23 hours ago


    Pune, Maharashtra, India Where U Elevate Full time

    Senior Big Data Engineer JobWe are seeking a seasoned Senior Big Data Engineer to join our team at Where U Elevate. This role requires someone who can design and implement robust data architecture, work with cross-functional teams, and ensure high-quality data products.Your Responsibilities:Design and implement scalable data architectureCollaborate with...


  • Pune, Maharashtra, India Mig Staffing Full time

    Job Title: Big Data Solutions DeveloperJob Description:Mig Staffing is seeking a Big Data Solutions Developer to design, implement, and manage our company's big data solutions. Key responsibilities include developing Hadoop systems, loading disparate data sets, conducting pre-processing services, and collaborating with software research and development...


  • Pune, Maharashtra, India Mig Staffing Full time

    About Mig StaffingWe are a leading staffing agency specializing in the placement of highly skilled professionals in various industries. Our team of experts works closely with clients to understand their unique needs and requirements.Job Title: Big Data Solutions ArchitectJob Summary:We are seeking an experienced Big Data Solutions Architect to join our team....


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc. is a 50-year-old industry leader in data, marketing solutions, sales, and research in the US.We have set up a strategic global centre of excellence in Pune, delivering mission-critical data services to our global customers powered by our proprietary cloud-based technology platform and leveraging our proprietary business &...

  • Data Engineer

    1 week ago


    Pune, Maharashtra, India LTIMindtree Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at LTIMindtree. As a Data Engineer, you will play a key role in designing and developing big data platforms using Scala and Spark.Responsibilities:Design and develop big data platforms using Scala and Spark.Develop expertise in Data Engineering, including hands-on experience in...


  • Pune, Maharashtra, India Classic Computers Corp DBA Harken Data Full time

    About the RoleWe are seeking a highly skilled Data Solutions Specialist to join our team at Classic Computers Corp DBA Harken Data. As a Data Solutions Specialist, you will be responsible for designing and implementing data warehousing and business intelligence solutions that help our clients make informed decisions.Key ResponsibilitiesDevelop and maintain...


  • Pune, Maharashtra, India Consulting Pandits Full time

    About Consulting PanditsWe are a leading consulting firm specializing in data-driven solutions.Job OverviewWe are seeking an experienced Big Data Engineer to join our team. This role will involve designing, developing, and deploying end-to-end data storage and processing pipelines using big data technologies.Estimated Salary Range$120,000 - $180,000 per year...