Senior Big Data Architect

3 hours ago

Amrāvati, Maharashtra, India beBeeDataiku Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Job Title: Dataiku, Python

We are seeking a highly skilled Big Data Administrator to manage our big data platform. The ideal candidate will possess in-depth knowledge of Hadoop, Hive, HBase, and BigSQL ecosystems.

  • Administer and monitor Big Data Platform components including Hadoop, Hive, HBase, BigSQL, etc.
  • Support technical and application teams with data copies across environments, data cleanup, query tuning, etc.
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Monitor and troubleshoot Big Data Platform including hosted DBs, tools, and services.
  • Create encryption zones, manage encryption keys, and copy data between the encryption zones.
  • Support projects and initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  • Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments.
  • Install new versions, patches, support upgrades of CDP Private Cloud and IBM BigSQL.
  • Monitor and troubleshoot platform issues and performance tuning.
  • Support security policies, documentation, and compliance.
  • Document processes and policies for Hadoop System Administration Platform support activities.
Required Skills and Qualifications:
  • Bachelor's or Master's degree in Computer Science or a relevant field of study.
  • 35 years of experience in Hadoop ecosystem, HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR.
  • 6 years of experience with Java and Linux/Unix.
  • 4 years of experience with security scripting and automation.
  • 2 years of experience in R, Python, Flume, Storm, Kafka.
  • 2 years of experience with IBM BigSQL or similar MPP SQL engines.
  • 2 years of experience with MySQL.
  • 1 year of experience with CI/CD.
  • Experience with administration and performance tuning of Hadoop distributions, open-source, and commercial.
  • Highly competent with Data Lake concepts and Big Data capabilities.
  • Good understanding of data virtualization, replication, and data governance.
  • Experience with AWS or other cloud-based Paas/Saas environments.
  • Experience with AWS EMR.
  • Strong communication skills.
  • Mandatory Skill: Dataiku.

  • Big Data Architect

    1 week ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    **Job Title:** Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, develop, and optimize large-scale data pipelines and distributed data processing systems.The ideal candidate will have a proven track record in building scalable cloud-based data architectures using Scala, Spark, Python, Apache Kafka, and NiFi.

  • Senior Big Data Solutions Architect Position

    1 week ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,30,00,000

    Big Data Architect Job OpportunityThis role is for an experienced Big Data Architect to lead multiple data engagements on cloud platforms.The ideal candidate will have more than 8 years of experience in technical roles, with a strong background in architecting, designing, and implementing end-to-end data pipelines and data integration solutions for varied...

  • Big Data Solutions Lead

    3 days ago

    Amrāvati, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 30,00,000

    Senior Big Data DeveloperWe are seeking a highly skilled Senior Big Data Developer to lead our big data development initiatives.Key Responsibilities:Analyzing complex data requirements and designing scalable solutions using Spark, Scala, and PySpark.Developing and deploying high-quality code in onshore-offshore working mode.Collaborating with...

  • Senior Data Pipeline Architect

    4 days ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking a highly skilled Senior Data Pipeline Architect to design and implement robust data pipelines for processing channel activity data from digital channels. This is an exciting opportunity to work on a greenfield project focused on integrating multiple sources of data.Key Responsibilities:Design and implement data pipelines using AWS...

  • Data Architect

    23 hours ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data ArchitectJob DescriptionWe are seeking a highly skilled Data Architect to join our team. As a Data Architect, you will play a key role in designing and implementing our data pipeline architecture.Key ResponsibilitiesCreate and maintain optimal data pipeline architecture.Design and implement internal process improvements: automating manual...

  • Senior Data Solutions Architect

    1 week ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 40,00,000

    Job DescriptionAs a Technical Lead at datae2e-technologies, you will be responsible for leading a team of talented data engineers to design and deliver scalable data pipelines and analytics platforms.The ideal candidate will have deep expertise in Big Data platforms, Microsoft Azure, and Databricks. You will oversee the development of end-to-end data...

  • Big Data Solutions Expert

    7 days ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Unlock your expertise in data processing and analytics as a Big Data Engineer.Key Responsibilities:Develop scalable big data solutions using PySpark and Hive to drive business growth.Collaborate with cross-functional teams to integrate big data platforms with other systems, ensuring seamless data flow.Work closely with data scientists and analysts to build...

  • Senior Big Data Specialist

    1 week ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Data EngineerSynopsis:As a seasoned data engineer, you will be responsible for designing and developing large-scale data processing systems using distributed computing frameworks like PySpark.Our ideal candidate is an expert in Big Data technologies, with hands-on experience in Python, AWS, and Spark.Mandatory Skills:PythonPySparkAWSBonus...

  • Lead Data Engineer

    1 day ago

    Amrāvati, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectThe role of a senior data architect involves making strategic decisions about the design and implementation of data systems. This includes selecting and integrating big data tools and frameworks to provide requested capabilities.This position requires a strong understanding of data warehousing and data modeling techniques, as...

  • Expert Data Technology Architect

    1 day ago

    Amrāvati, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Big Data Engineer with deep expertise in data technologies and cloud services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation within the team.Key Responsibilities-Design, develop, and optimize big data...