Big Data Platform Expert

17 hours ago

Ahmedabad, Gujarat, India beBeeDataiku Full time ₹ 80,00,000 - ₹ 1,50,00,000

Expertise in big data platforms is key to driving business innovation and excellence.

About the role:

  • Manage a range of big data platform components including Hadoop, Hive, HBase and BigSQL.
  • Support technical and application teams with requests for data copies across environments, data cleanup, query tuning, etc.
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Monitor and troubleshoot big data platforms hosted DBs, tools and services.
  • Work with encryption keys, managing encryption zones and copying data between them.
  • Support projects and initiatives related to data acquisition, processing and utilization through big data platforms.
  • Maintain and support big data platforms CDP private cloud and IBM BigSQL across multiple environments.
  • Install new versions, patches and support upgrades of CDP private cloud and IBM BigSQL.
  • Monitor and troubleshoot platform issues, performance tuning, etc.
  • Document processes and policies for hadoop system administration and platform support activities.

Requirements:

  • 35 years of experience in Hadoop ecosystem, HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR.
  • 6 years of experience with Java and Linux/Unix.
  • 4 years of experience with security scripting and automation.
  • 2 years of experience in R, Python, Flume, Storm, Kafka.
  • 2 years of experience with IBM BigSQL or similar MPP SQL engines.
  • 2 years of experience with MySQL.
  • 1 year of experience with CICD.

Key qualifications include:

  • Highly competent with data lake concepts and big data capabilities.
  • Good understanding of data virtualization and replication.
  • Experience with administration and performance tuning of hadoop distributions, open source and commercial.
  • Strong communication skills.
  • Experience with AWS or other cloud-based PaaS/SaaS environments.
  • Experience with AWS EMR.

The ideal candidate will have strong problem-solving skills, be able to work independently and as part of a team, and have excellent communication and interpersonal skills.

Mandatory Skills: Dataiku

  • Big Data Analytics Expert

    1 week ago

    Ahmedabad, Gujarat, India beBeeBigDataAnalytics Full time ₹ 25,00,000 - ₹ 30,00,000

    About the RoleWe are seeking an experienced professional to join our team as a Big Data Analytics Expert. This role will involve working with large datasets and developing scalable solutions using Apache Druid.Key ResponsibilitiesDesign, develop, and maintain high-performance data pipelines using Apache Druid.Collaborate with cross-functional teams to...

  • Big Data

    1 week ago

    Ahmedabad, Gujarat, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Professional

    1 week ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data AnalystA senior big data analyst position is available for a highly skilled professional to leverage their knowledge of big data analytics and drive business outcomes. The ideal candidate will have experience working with large datasets, developing and implementing data-driven solutions, and collaborating with cross-functional teams.Key...

  • Data Platform Specialist

    5 days ago

    Ahmedabad, Gujarat, India beBeeCloudExpert Full time ₹ 9,00,000 - ₹ 15,00,000

    Job Title: Business AnalystWe are seeking a technical expert to support our enterprise platform operations, data automation, cloud cost optimization, and infrastructure resilience.Key Responsibilities:Analyze workflows, define performance metrics, and build dashboards for informed decision-making.Support cloud cost optimization (reservation utilization,...

  • Innovative Big Data Solutions Expert

    3 days ago

    Ahmedabad, Gujarat, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Developer PositionAs a key member of our data-driven organization, we are seeking an experienced Big Data Developer to join our team.The ideal candidate will have a proven track record of designing, developing, and implementing big data solutions using cutting-edge technologies such as Spark, Scala, and PySpark. The successful candidate will be...

  • Big Data Engineer

    2 days ago

    Ahmedabad, Gujarat, India beBeeCloudEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking an experienced big data engineer to join our cloud solutions team. The ideal candidate will have a strong background in data engineering and experience with cloud services.Main Responsibilities:Design, develop, and maintain large-scale data pipelines using cloud-based technologiesWork closely with cross-functional teams to...

  • Senior Big Data Architect

    22 hours ago

    Ahmedabad, Gujarat, India beBeeDataStrategist Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    The most impactful opportunity awaits!Job DescriptionWe are seeking an exceptional Big Data Strategist to spearhead the development of our Enterprise TruRisk Platform. This pioneering project aims to empower customers with unparalleled Cyber Risk Management capabilities.This role offers a chance to work closely with a talented team of engineers and...

  • Big Data Developer

    9 hours ago

    Ahmedabad, Gujarat, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Infrastructure SpecialistWe're looking for an experienced Data Infrastructure Specialist to lead the development and maintenance of our data pipelines. This is a critical role that requires a strong understanding of distributed data systems, cloud platforms, and data warehousing.Key Responsibilities:Design, develop, and manage end-to-end data pipelines...

  • Data Platform Specialist

    3 days ago

    Ahmedabad, Gujarat, India beBeeSpecialist Full time ₹ 2,00,00,000 - ₹ 3,50,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to lead the design and implementation of enterprise data platforms.Key Responsibilities:Create scalable, reliable, and secure data infrastructure for large organizations.Drive innovation and adoption of new technologies, researching and integrating...

  • Big Data Specialist

    5 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Big Data Specialist to join our team.Responsibilities:Analyze and process large data sets using Big Data technologiesDevelop and implement scalable data pipelinesWork with cross-functional teams to deliver high-quality solutionsRequirements:2+ years of experience in Big Data engineeringStrong skills in Scala, AWS, and...