
Big Data Platform Manager
2 days ago
About the Role:
- We are seeking a skilled Data Administrator to manage our big data platform.
Responsibilities include:
- Handling day-to-day operations, administering and monitoring Big Data Platform components including Hadoop, Hive, HBase, BigSQL, etc.
- Supporting Technical and Application team requests for data copies across environments, data cleanup, query tuning, etc.
- Troubleshooting and resolving issues related to user queries, application jobs, etc.
- Monitoring and troubleshooting Big Data Platform including hosted DBs, tools, and services.
- Creating encryption zones, managing encryption keys, and copying data between the encryption zones.
Requirements:
- Bachelor's or Master's degree in Computer Science or an applicable field of study.
- 35 years of experience in Hadoop Ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR).
- 6 years of experience with Java and Linux/Unix.
- 4 years of experience with Security Scripting and Automation.
- 2 years of experience in R, Python, Flume, Storm, Kafka.
- 2 years of experience with IBM BigSQL or similar MPP SQL Engines.
- 2 years of experience with MYSQL.
- 1 year of experience with CICD.
- Experience with administration and performance tuning of Hadoop distributions (open source and commercial).
- Highly competent with Data Lake concepts and Big Data capabilities.
- Good understanding of data virtualization, replication, Data G.
- Experience with AWS or other cloud-based PaaS/SaaS environments.
- Experience with AWS EMR.
- Strong communication skill.
- Mandatory Skills: Dataiku.
-
Big Data Professional
3 days ago
Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Big Data Developer OpportunityWe're seeking an experienced professional to design and implement scalable big data solutions using cutting-edge technologies.Main Responsibilities:Create high-performance big data architectures leveraging Spark, SQL, Hive, and Scala.Collaborate with cross-functional teams to drive data-driven decision making across the...
-
Big Data Specialist
1 week ago
Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Key ResponsibilitiesWe design, develop and maintain data pipelines for ingestion, transformation and storage of large-scale data.Our team works with Big Data ecosystems to process structured and unstructured data.We develop efficient ETL processes to integrate data from multiple sources into data warehouses/lakes.We write and optimize SQL queries for data...
-
Big Data Engineering Leader
1 week ago
Vijayawada, Andhra Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 3,00,00,000Sigma empowers enterprises to make informed decisions by blending data engineering with AI consulting. Our collaboration spans sectors including CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges.Our global team specializes in cloud data modernization, predictive analytics, generative AI, and DataOps, supported by...
-
Senior Big Data Engineer
2 hours ago
Vijayawada, Andhra Pradesh, India Veltris Full timeVeltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...
-
Big Data Database Engineer
1 week ago
Vijayawada, Andhra Pradesh, India beBeeDatabase Full time ₹ 15,00,000 - ₹ 24,00,000Job Summary:Oversees the administration of large-scale data systems to ensure optimal performance and support.Analyzes existing database structures and recommends improvements to enhance efficiency and security.Utilizes expertise to design, implement, and maintain secure database configurations and best practices.Collaborates with data engineers and...
-
Big Data Engineering Expert
2 weeks ago
Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000Job Title: Senior Big Data EngineerAbout the RoleWe are seeking a highly skilled Senior Big Data Engineer to join our team. The ideal candidate will have hands-on experience with AWS, Python, and PySpark.Key ResponsibilitiesDesign, develop, and deploy scalable big data architectures using AWS services such as Amazon EMR, Amazon Athena, and AWS Glue.Work...
-
Lead Big Data Developer
4 days ago
Vijayawada, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Job Title:Data Engineer About the Role: We are seeking an experienced Data Engineer to join our team. As a key member of our data organization, you will be responsible for designing, building, and maintaining large-scale data systems. This role requires strong technical skills, excellent communication skills, and the ability to work collaboratively with...
-
A Seasoned Big Data Expert Wanted
6 days ago
Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Big Data SpecialistWe are seeking a talented and experienced Big Data Specialist to join our team. The ideal candidate will have a strong background in big data technologies, including PySpark/Scala Spark/Java Spark SQL.The successful applicant will possess excellent analytical and problem-solving skills, with the ability to design and implement effective...
-
Highly Skilled Big Data Specialist
5 days ago
Vijayawada, Andhra Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,50,00,000Job OverviewAs a Big Data Professional, you will play a key role in designing and developing large-scale data processing systems using cutting-edge big data technologies.
-
Senior Data Analyst
1 week ago
Vijayawada, Andhra Pradesh, India beBeeBigData Full time ₹ 80,00,000 - ₹ 1,50,00,000Job OverviewAs a seasoned professional, you will be responsible for managing and analyzing large datasets to extract valuable insights.Key Responsibilities:Develop and implement data management strategies to optimize data quality and integrityAnalyze complex data sets to identify trends and patternsTechnical Requirements:Expertise in PySpark and Hive...