
Big Data Administrator
2 days ago
We are looking for a skilled Dataiku Administrator to manage our big data platform.
- Administer and monitor Big Data Platform components Hadoop Hive HBase BigSQL etc
- Support Technical and Application team requests data copies across environments data cleanup query tuning etc
- Troubleshoot and resolve issues related to user queries application jobs etc
- Monitor and troubleshoot Big Data Platform including hosted DBs tools and services
- Creating encryption zones managing encryption keys and copying data between the encryption zones
- Support projectsinitiatives related to data acquisition processing and utilization through Big Data Platform
- Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments
- Install new versions patches support upgrades of CDP Private Cloud and IBM BigSQL
- Monitor and troubleshoot platform issues and performance tuning
- Support security policies documentation and compliance
- Document processes and policies for Hadoop System Administration Platform support activities
- Bachelors or Masters degree in Computer Science or applicable field of study
- 35 Years Of Experience In Hadoop Ecosystem HDFS MapReduce Hive HBase Spark Scala Yarn Sqoop Ranger Knox Kerberos LDAP SOLR
- 6 Years Of Experience With Java And LinuxUnix
- 4 Years Of Experience With Security Scripting and Automation
- 2 Years Of Experience In R Python Flume Storm Kafka
- 2 Years Of Experience With IBM BigSQL Or Similar MPP SQL Engines
- 2 Years Of Experience with MYSQL
- 1 Years Of Experience with CICD
- Experience with administration and performance tuning of Hadoop distributions open source and commercial
- Highly competent with Data Lake concepts and Big Data capabilities
- Good understanding of data virtualization replication Data G
- Experience with AWS or other Cloudbased PaaSSaaS environments
- Experience with AWS EMR
- Strong communication skill
- Mandatory Skills : Dataiku
- Prior experience working with big data systems and technologies is highly valued
- Familiarity with Dataiku and its features is a plus
-
Big Data Ecosystems Manager
3 days ago
Lucknow, Uttar Pradesh, India beBeeKafka Full time ₹ 15,00,000 - ₹ 25,00,000Immersive technology drives innovation in big data ecosystems, and we're looking for an experienced professional to spearhead our Kafka administration efforts. This individual will be responsible for installing, configuring, and managing large-scale clusters on-premises and in the cloud. Ideally, they'll have a strong background in big data and hands-on...
-
Big Data Specialist
3 days ago
Lucknow, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 18,00,000 - ₹ 24,00,000Big Data Specialist PositionWe are seeking a seasoned Big Data specialist to fill this key role. The ideal candidate will have a strong background in programming languages, particularly Java and Scala, with hands-on experience in developing big data applications using Apache Spark Frameworks and Unix Shell scripting.Key Responsibilities:Develop high-quality...
-
Big Data Specialist
6 days ago
Lucknow, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000Job Description:The ideal candidate will design, develop and maintain large-scale data processing systems using Big Data technologies.Key Responsibilities:Develop scalable data pipelines to integrate various data sources.Implement data validation and error handling mechanisms to ensure data quality and integrity.Collaborate with cross-functional teams to...
-
Big Data Engineering Lead
1 week ago
Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,80,00,000Big Data Engineer Job DescriptionWe are seeking a highly skilled Big Data Engineer to lead the design, development, and implementation of scalable data processing solutions using big data technologies.The ideal candidate will have 6-12 years of experience in big data engineering and a proven track record of delivering high-quality solutions on time. They...
-
Big Data Technical Lead
2 days ago
Lucknow, Uttar Pradesh, India beBeeTechnical Full time ₹ 35,00,000 - ₹ 50,00,000Job Title: Big Data Technical LeadThis is an exciting opportunity to join a team of innovators and work on cutting-edge projects. We are seeking a highly skilled Big Data Technical Lead to lead the design, implementation, and maintenance of our big data platform.
-
Big Data Specialist
1 week ago
Lucknow, Uttar Pradesh, India beBeeDataProcessing Full time ₹ 15,00,000 - ₹ 20,00,000Job TitleAs a Data Processing Specialist, you will be responsible for building and managing big data clusters to ensure efficient data processing and storage. Your role will involve migrating data, performing performance tuning, and providing pre- and post-platform support for application migration. Proficiency in Linux commands is mandatory.In this...
-
Advanced Big Data Expert
5 days ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Big Data Engineering PositionThe role involves designing, executing and managing large and complex distributed data systems using cutting-edge technologies.Key technologies include Apache Hadoop, Java, Elastic Search/Solr, Kafka, Spark, Machine Learning, NLP and Deep Learning.Applicants will have 2-4 years of experience in big data technologies, including...
-
Big Data Engineering Expert
5 days ago
Lucknow, Uttar Pradesh, India beBeeData Full time US$ 1,49,999 - US$ 2,49,999Big Data Engineering ExpertJob Overview:We are seeking an experienced Big Data Engineer to lead our data engineering teams. As a key member of our organization, you will be responsible for designing and implementing scalable data pipelines using Scala and Python.Key Responsibilities:Manage cross-team collaboration with architects, product managers, and...
-
Big Data Architect
3 days ago
Lucknow, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Senior Big Data EngineerWe are seeking an experienced Senior Big Data Engineer to build and maintain robust data pipelines, design scalable data lakes, and collaborate with cross-functional teams.Key ResponsibilitiesDesign and implement large-scale ETL pipelines using PySpark and AWS Glue to process high-volume datasets.Collaborate with analysts,...
-
Senior Big Data Specialist
5 days ago
Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 24,00,000Job OpportunityWe are seeking an experienced Data Engineer to join our team.About the RoleThis is a 4-10 year experience role with a focus on big data technologies such as Hadoop, Spark, and Scala programming languages.The ideal candidate will have strong SQL skills and be able to develop, tweak queries and work on performance enhancement.Key...