AWS Big Data Engineer
3 months ago
Job Description
We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch processing on the Big Data platform.● Set up and run Hadoop development frameworks.● Collaborate with a team of business domain experts, data scientists, and application developers to identify relevant data for analysis and develop the Big Data solution.● Explore and learn new technologies for creative business problem-solving.#LI-UNPostJob Requirement Ability to develop and manage scalable Hadoop cluster environments● Ability to design solutions for Big Data applications● Experience in Big Data technologies like HDFS, Hadoop, Hive, Yarn, Pig, HBase, Sqoop, Flume, etc● Working experience on Big Data services in any cloud-based environment.● Experience in Spark, Pyspark, Python or Scala, Kafka, Akka, core or advanced Java, and Databricks● Knowledge of how to create and debug Hadoop and Spark jobs● Experience in NoSQL technologies like HBase, Cassandra, MongoDB, Cloudera, or Hortonworks Hadoop distribution● Familiar with data warehousing concepts, distributed systems, data pipelines, and ETL● Familiar with data visualization tools like Tableau● Good communication and interpersonal skills● Minimum 6+ years of Professional experience with 3+ years of Big Data project experience● B.Tech/B.E from reputed institute preferred#LI-UNPost-
Big data engineer
3 months ago
Hyderabad, India Virtusa Full timeBig data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...
-
Big Data Engineer
1 month ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5-6 years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Big Data Engineer
2 weeks ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
AWS Big Data Architect
3 months ago
Hyderabad, India Tiger Analytics Full timeJob Description As an AWS Data Architect), you will analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. Analyze, architect, design, and actively develop cloud data warehouses, data lakes, and other cloud-based data solutions in AWS. AWS experts with strong experience in...
-
AWS Data Architect
6 months ago
Hyderabad, India HuQuo Full timeRole Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role...
-
Senior Big Data Engineer
3 days ago
Hyderabad, India Findernest Software Services Pvt Ltd Full timeOverview:The Senior Big Data Engineer plays a crucial role in our organization responsible for designing developing and maintaining scalable big data solutions. This role is essential in harnessing the power of data to drive informed business decisions and strategic initiatives.Key Responsibilities:Design and implement big data solutions using technologies...
-
Big Data Engineer
3 days ago
hyderabad, India Anblicks Full time4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...
-
Big Data Engineer
3 weeks ago
hyderabad, India Anblicks Full time4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...
-
Senior Big Data Engineer
6 days ago
Hyderabad, India Findernest Software Services Pvt Ltd Full timeOverview:The SeniorBig Data Engineer plays a crucial role in our organizationresponsible for designing developing and maintaining scalable bigdata solutions. This role is essential in harnessing the power ofdata to drive informed business decisions and strategicinitiatives.KeyResponsibilities:Design andimplement big data solutions using technologies such as...
-
AWS Data Engineer
1 month ago
Hyderabad, India TekPillar Full timeJob Title : AWS Data EngineerExperience : 4-8 Years Location : HyderabadKey Responsibilities :- Design, develop, and maintain scalable data pipelines and ETL processes using AWS services such as Glue, Lambda, and Athena.- Work with big data technologies like Hadoop and PySpark to process and analyze large datasets.- Develop and optimize data models in a...
-
Big Data Engineer
3 weeks ago
Hyderabad, India Anblicks Full time4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...
-
Big Data Engineer
3 weeks ago
Hyderabad, India Anblicks Full time4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...
-
Big Data Engineer
4 days ago
hyderabad, India Anblicks Full time4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...
-
Senior Big Data Software Engineer
4 months ago
Hyderabad, India Epam Full timeDescription EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...
-
Senior Software Engineer
3 months ago
Hyderabad, India Experian Full timeJob Description Job responsibilities: The Senior Data Engineer at Experian India will work on Decisioning Analytics North America software and platforms with a focus on security remediation. Additional work areas will also include technical debt improvements and the implementation new features. Applications supported will include Precise ID, Precise...
-
DW and Big Data engineer
4 months ago
hyderabad, India Anicalls (Pty) Ltd Full time• Cloud Data Analytics (AWS, Oracle, Azure, Snowflake) – Hands-on solution design experience in at least two of cloud platforms.• Experience in growing & mining existing accounts• Experience in implementing at least 4 Cloud Data Analytics & Big Data engagements.• Extensive experience in solution design in complex projects in big data, cloud...
-
AWS Data Engineer
6 days ago
hyderabad, India Veltris Full timeRole: Data EngineerExperience: 5-10 YearsWorking Days: 5 DaysLocation: HyderabadNotice Period – Immediate or 15 days maximum.Key Responsibilities:• Design, implement, and maintain data pipelines for large-scale data processing.• Develop and manage workflow orchestration using Dagster or Apache Airflow.• Work with various databases including ...
-
Data Developer
2 months ago
Hyderabad, India Selsoftinc Full timeResponsibilities :- Experience in a Big Data technologies (Spark, Redshift, Kafka, etc.)- Experience programming in JAVA and Python- Experience performing data analysis (NOT DATA SCIENCE) on AWS platforms- Experience with data management process on AWS is a huge Plus- Experience in implementing complex ETL transformations on AWS using Glue- Familiarity with...
-
Big Data Engineer, Data Modeling
4 months ago
Hyderabad, India data.ai Remote Work Freelance Full timeWhat can you tell your friends when they ask you what you do? We’re looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and...
-
Big Data Engineer JavaPython DSA
3 days ago
Hyderabad, India Vidpro Consultancy Services Full timeThis position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles experience in programming in Java Python or similar languages and can expect to spend a majority of their time coding.Experience: 47 YearsLocation: Bangalore &...