AWS Big Data Engineer

3 months ago


Hyderabad, India Tiger Analytics Full time

Job Description

We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.● Set up and run Hadoop development frameworks.● Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.● Explore and learn new technologies for creative business problem-solving.#LI-UNPostJob Requirement Ability to develop and manage scalable Hadoop cluster environments● Ability to design solutions for Big Data applications● Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc● Working experience on Big Data services in any cloud-based environment.● Experience in Spark, Pyspark, Python or Scala, Kafka, Akka, core or advanced Java, and Databricks● Knowledge of how to create and debug Hadoop and Spark jobs● Experience in NoSQL technologies like HBase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop distribution● Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL● Familiar with data visualization tools like Tableau● Good communication and interpersonal skills● Minimum 6+ years of Professional experience with 3+ years of Big Data project experience● B.Tech/B.E from reputed institute preferred#LI-UNPost
  • Big data engineer

    3 months ago


    Hyderabad, India Virtusa Full time

    Big data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...

  • Big Data Engineer

    1 month ago


    Hyderabad, India NucleusTeq Full time

    Big Data Engineer Responsibilities: Big Data Engineer with 5-6 years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...

  • Big Data Engineer

    2 weeks ago


    Hyderabad, India NucleusTeq Full time

    Big Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...

  • AWS Big Data Architect

    3 months ago


    Hyderabad, India Tiger Analytics Full time

    Job Description As an AWS Data Architect), you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. AWS experts with strong experience in...

  • AWS Data Architect

    6 months ago


    Hyderabad, India HuQuo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role...


  • Hyderabad, India Findernest Software Services Pvt Ltd Full time

    Overview:The Senior Big Data Engineer plays a crucial role in our organization responsible for designing developing and maintaining scalable big data solutions. This role is essential in harnessing the power of data to drive informed business decisions and strategic initiatives.Key Responsibilities:Design and implement big data solutions using technologies...

  • Big Data Engineer

    3 days ago


    hyderabad, India Anblicks Full time

    4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...

  • Big Data Engineer

    3 weeks ago


    hyderabad, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...


  • Hyderabad, India Findernest Software Services Pvt Ltd Full time

    Overview:The SeniorBig Data Engineer plays a crucial role in our organizationresponsible for designing developing and maintaining scalable bigdata solutions. This role is essential in harnessing the power ofdata to drive informed business decisions and strategicinitiatives.KeyResponsibilities:Design andimplement big data solutions using technologies such as...

  • AWS Data Engineer

    1 month ago


    Hyderabad, India TekPillar Full time

    Job Title : AWS Data EngineerExperience : 4-8 Years Location : HyderabadKey Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL processes using AWS services such as Glue, Lambda, and Athena.- Work with big data technologies like Hadoop and PySpark to process and analyze large datasets.- Develop and optimize data models in a...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...

  • Big Data Engineer

    3 weeks ago


    Hyderabad, India Anblicks Full time

    4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...

  • Big Data Engineer

    4 days ago


    hyderabad, India Anblicks Full time

    4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...


  • Hyderabad, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...


  • Hyderabad, India Experian Full time

    Job Description Job responsibilities: The Senior Data Engineer at Experian India will work on Decisioning Analytics North America software and platforms with a focus on security remediation. Additional work areas will also include technical debt improvements and the implementation new features. Applications supported will include Precise ID, Precise...


  • hyderabad, India Anicalls (Pty) Ltd Full time

    • Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms.• Experience in growing & mining existing accounts• Experience in implementing at least 4 Cloud Data Analytics & Big Data engagements.• Extensive experience in solution design in complex projects in big data, cloud...

  • AWS Data Engineer

    6 days ago


    hyderabad, India Veltris Full time

    Role: Data EngineerExperience: 5-10 YearsWorking Days: 5 DaysLocation: HyderabadNotice Period – Immediate or 15 days maximum.Key Responsibilities:• Design, implement, and maintain data pipelines for large-scale data processing.• Develop and manage workflow orchestration using Dagster or Apache Airflow.• Work with various databases including ...

  • Data Developer

    2 months ago


    Hyderabad, India Selsoftinc Full time

    Responsibilities :- Experience in a Big Data technologies (Spark, Redshift, Kafka, etc.)- Experience programming in JAVA and Python- Experience performing data analysis (NOT DATA SCIENCE) on AWS platforms- Experience with data management process on AWS is a huge Plus- Experience in implementing complex ETL transformations on AWS using Glue- Familiarity with...


  • Hyderabad, India data.ai Remote Work Freelance Full time

    What can you tell your friends when they ask you what you do? We’re looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...


  • Hyderabad, India Vidpro Consultancy Services Full time

    This position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles experience in programming in Java Python or similar languages and can expect to spend a majority of their time coding.Experience: 47 YearsLocation: Bangalore &...