Lead - Big Data Developer
3 months ago
Job Description:
5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive
Bachelors or masters degree in Computer Science or related field
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Advanced knowledge of the Hadoop ecosystem and its components
In-depth knowledge of Hive, Shell scripting, Python, Spark
Ability to write MapReduce jobs
Experience using Job Schedulers like Autosys
Hands on experience in HiveQL
Good knowledge on Hadoop Architecture and HDFS
Strong knowledge of working with large data sets and high-capacity big data processing platform
Strong experience in Unix and Shell scripting
Experience with jenkins for Continuous Integration
Experience using Source Code and Version Control Systems like Bitbucket, Git
Good to have experience on Agile Development
Responsibilities: Develop components, application interfaces, and solution enablers while ensuring principal architecture integrity is maintained
Ensures solutions are well designed with maintainability/ease of integration and testing built-in from the outset
Participates and guides team in estimating work necessary to realize a story/requirement through the software delivery lifecycle
Responsible for developing and delivering complex software requirements to accomplish business goals
Ensures that software is developed to meet functional, non-functional, and compliance requirements
Codes solutions, Unit testing and ensure the solution can be integrated successfully into the overall application/system with clear robust, and well-tested interfaces
Required Skills: Hadoop, Hive, HDFS, Spark, Python, Unix
-
Big Data Developer
4 months ago
Hyderabad, India Virtusa Full timeBig Data Developer - CREQ189736 Description Job Description: 5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience...
-
Big Data Lead
1 month ago
Hyderabad, India Lovoro Tech Full timeThe Role :We are looking for an experienced and highly skilled Big Data Lead to join our team and drive the design, implementation, and management of our big data infrastructure. The ideal candidate will have a deep understanding of data lake architectures, big data technologies, and data engineering processes. This role requires expertise in handling...
-
Big Data Engineer
1 month ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5-6 years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Big Data Engineer
3 weeks ago
Hyderabad, India NucleusTeq Full timeBig Data Engineer Responsibilities: Big Data Engineer with 5+ years of experienceExperience in leading a team of engineers and a good attitude toward learning the domain and implementationStrong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.Finalizing the scope of the system and delivering...
-
Opening for Big data Developer
4 months ago
Hyderabad, India @ Six Sigma Full timeJob Details Requirement Type Permanent Job Title Opening for Big data Developer Job Level Executive - Non-Managerial Job Description Big data Developer No. of Openings 6 Job Domain IT Experience - Minimum - Maximum data Expected Date Of Joining 2023-11-16 Joining Time 5 Days Salary 54,167 Work Locations Hyderabad Required skills Big data
-
Big data engineer
3 months ago
Hyderabad, India Virtusa Full timeBig data engineer - CREQ189284 Description Position: Big data engineer Primary: big data concepts, aws, pyspark Location: HYD Create Trigger based automation framework for Data Migration Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same Integrate CDMS framework with Lake and Data bridge...
-
GCP ARCHITECT with BIG DATA
1 week ago
Hyderabad, India Tetrahed INC Full timeKey ResponsibilitiesDesigning and implementing scalable highperformance GCPbased big data solutionsLeading architecture design discussions with stakeholders to understand requirements and align on solutionsDeveloping data pipelines and ETL processes to move transform and aggregate large volumes of dataOptimizing data storage retrieval and processing using...
-
Data Developer
2 months ago
Hyderabad, India Selsoftinc Full timeResponsibilities :- Experience in a Big Data technologies (Spark, Redshift, Kafka, etc.)- Experience programming in JAVA and Python- Experience performing data analysis (NOT DATA SCIENCE) on AWS platforms- Experience with data management process on AWS is a huge Plus- Experience in implementing complex ETL transformations on AWS using Glue- Familiarity with...
-
Senior Big Data Engineer
1 week ago
Hyderabad, India Findernest Software Services Pvt Ltd Full timeOverview:The Senior Big Data Engineer plays a crucial role in our organization responsible for designing developing and maintaining scalable big data solutions. This role is essential in harnessing the power of data to drive informed business decisions and strategic initiatives.Key Responsibilities:Design and implement big data solutions using technologies...
-
GCP ARCHITECT with BIG DATA
2 months ago
Hyderabad, India Tetrahed INC Full timeKeyResponsibilitiesDesigning andimplementing scalable highperformance GCPbased big datasolutionsLeading architecture designdiscussions with stakeholders to understand requirements and alignon solutionsDeveloping data pipelines and ETLprocesses to move transform and aggregate large volumes ofdataOptimizing data storage retrieval andprocessing using GCP...
-
Big Data Engineer
3 days ago
Hyderabad, India RiDiK (a Subsidiary of CLPS. Nasdaq: CLPS) Full timeJob Summary:We are seeking a skilled and innovative Big Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, building, and maintaining scalable data processing systems. You will work with large datasets and implement data pipelines to ensure data quality and availability for analytics and business intelligence...
-
Big Data Engineer
1 week ago
hyderabad, India Anblicks Full time4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...
-
Senior Big Data Engineer
2 weeks ago
Hyderabad, India Findernest Software Services Pvt Ltd Full timeOverview:The SeniorBig Data Engineer plays a crucial role in our organizationresponsible for designing developing and maintaining scalable bigdata solutions. This role is essential in harnessing the power ofdata to drive informed business decisions and strategicinitiatives.KeyResponsibilities:Design andimplement big data solutions using technologies such as...
-
AWS Big Data Engineer
3 months ago
Hyderabad, India Tiger Analytics Full timeJob Description We are looking for a Senior Data Engineer to be based out of our Chennai, Bangalore & Hyderabad offices. This role involves a combination of hands-on contribution, customer engagement, and technical team management. As a Senior Data Engineer, you will Design and build solutions for near real-time stream processing as well as batch...
-
Big Data Engineer
4 weeks ago
hyderabad, India Anblicks Full time4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...
-
Big Data Solution Architect
4 months ago
Hyderabad, India Epam Full timeDescription EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...
-
GCP Big Data Engineer
2 months ago
Hyderabad, India Tetrahed INC Full timeRelevant experience for engagement: 10Years Relevant skillset: Maintain architecture principles guidelinesand standards Data Warehousing Programming Language: Python/Java Big Data DataAnalytics GCP ServicesRelevanttechnology domains: Experience in designing& implementing solution in mentioned areas: Strong GoogleCloud Platform Data Components BigQuery...
-
Big Data Engineer
4 weeks ago
Hyderabad, India Anblicks Full time4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...
-
Big Data Engineer
1 week ago
hyderabad, India Anblicks Full time4-6 years of experience:Experience in hadoop/big data technologies.experience in spark.experience in Snowflakeexperience working on Google or AWS cloud developing data solutions. Certifications preferred.Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required;Experience with containerization and related technologies...
-
Big Data Engineer
4 weeks ago
Hyderabad, India Anblicks Full time4-6 years of experience: Experience in hadoop/big data technologies. experience in spark. experience in Snowflake experience working on Google or AWS cloud developing data solutions. Certifications preferred. Hands-on experience with Python/Pyspark/Scala and basic libraries for machine learning is required; Experience with containerization and related...