Big Data and Analytics Expert

2 days ago

Delhi, Delhi, India beBeeHadoop Full time

Big Data and Hadoop Expertise is crucial for designing, building, and maintaining scalable data solutions. You'll work with technologies to ensure smooth data operations and contribute significantly to business objectives through expert analysis, development, implementation, and troubleshooting within the Big Data domain.

Roles and Responsibilities:

  • Platform Management: Install, configure, and maintain big data components (e.g., HDFS, YARN) to ensure optimal performance, scalability, and high availability.
  • Data Pipeline Development: Design, develop, and implement robust and efficient data pipelines for ingestion, processing, and transformation of large datasets using tools like Apache Spark, Hive, or Kafka.
  • Performance Tuning: Monitor the performance of big data clusters and applications. Identify bottlenecks and implement optimization strategies for Spark jobs, Hive queries, and other big data processes.
  • Data Lake/Warehouse Design: Contribute to the design and implementation of data lake and data warehouse solutions leveraging Hadoop-based technologies.
  • ETL/ELT Processes: Develop and manage complex ETL/ELT processes to integrate data from various sources into the big data ecosystem.
  • Troubleshooting: Perform in-depth troubleshooting, debugging, and resolution for complex issues within the Hadoop ecosystem, including cluster stability, data processing failures, and performance degradation.
  • Security & Governance: Implement and maintain security best practices for big data platforms, including access control, encryption, and data governance policies.
  • Automation: Develop scripts and automation routines for cluster management, deployment, monitoring, and routine operational tasks within the big data environment.
  • Collaboration: Work closely with data scientists, data analysts, application developers, and infrastructure teams to support data-driven initiatives.

Preferred Candidate Profile:

  • Hadoop Ecosystem Expertise: Strong hands-on experience with core components of the Hadoop ecosystem (HDFS, YARN) and related technologies like Apache Spark, Hive, Kafka, HBase, or Presto.
  • Programming/Scripting: Proficient in programming languages commonly used in big data, such as Python, Scala, or Java. Strong scripting skills for automation.
  • SQL Proficiency: Excellent proficiency in SQL for data manipulation and querying in big data environments (e.g., HiveQL, Spark SQL).
  • Cloud Big Data: Familiarity with cloud-based big data services is a plus.
  • Distributed Systems: Understanding of distributed computing principles and challenges in managing large-scale data systems.
  • Problem-Solving: Excellent analytical and problem-solving skills with a methodical approach to complex big data challenges.
  • Communication: Strong verbal and written communication skills to articulate technical concepts and collaborate effectively with diverse teams.
  • Education: Bachelor's degree in Computer Science, Data Engineering, Information Technology, or a related technical field.

This is an exciting opportunity to leverage your expertise in big data and Hadoop ecosystems to drive business growth and success.

  • Big Data Solutions Expert

    1 day ago

    Delhi, Delhi, India beBeeCloud Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Cloud Data Solutions ArchitectWe are seeking a highly skilled Cloud Data Solutions Architect to design, develop, and maintain big data solutions on AWS. As a key member of our team, you will be responsible for implementing data processing architectures, ensuring scalability, security, and cost-effectiveness of data solutions.Design and develop big...

  • Senior Big Data Engineer

    4 weeks ago

    Delhi, Delhi, India huns info pvt ltd Full time

    Senior Data :- Skilled and experienced Sr. Data Engineer with proven experience in Spark, Kafka, Hadoop, Data Management.Skills :- Proficiency in programming languages Scala, Java, Python.- Experience with design and development of ELT workflows and data pipelines for high-volume data systems e.g. Datastage, Informatica, Talend, etc.- Experience in Data...

  • Full Stack Big Data Engineer

    3 weeks ago

    Delhi, Delhi, India Upamp Business Solutions Full time

    About the advertising data flow team :The advertising data flow team is responsible for the streaming and batch data processes that power our reporting, analytics, attribution, forecasting, optimization, ad delivery, and billing systems with a business focus on accurately associating real-world visits to digital media impressions and growing our connected TV...

  • Engineering Manager – Big Data, Azure

    4 weeks ago

    Delhi, Delhi, India DataE2E Technologies Full time

    Job Title: Engineering Manager – Big Data, Azure & DatabricksLocation: RemoteEmployment Type: Full-timeDepartment: Data Engineering / TechnologyExperience: 8+ years (3+ years in a managerial role)About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms , Microsoft Azure , and ...

  • Advanced Big Data Professional

    1 day ago

    Delhi, Delhi, India beBeeDataEngineering Full time US$ 90,000 - US$ 1,80,000

    Big Data Engineer PositionJob description: Our team is looking for a skilled Big Data Engineer to join our effort in building and maintaining large-scale data processing systems.Required skills:AWS, Python, Pyspark - Experience with these technologies is mandatory.5+ years of overall IT experienceHands on experience in Big Data technologiesAbility to work...

  • Cloud-Based Big Data Specialist

    3 hours ago

    Delhi, Delhi, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Big Data Solutions SpecialistJob Summary:The ideal candidate will be responsible for designing, developing, and maintaining scalable data solutions on the cloud.This role requires a deep understanding of big data technologies, cloud architecture, and best practices in data engineering to ensure seamless integration with cross-functional teams.Key...

  • Lead Data Scientist

    1 day ago

    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: Azure Data Engineer Role Overview:We are seeking a highly skilled and experienced Data Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Databricks.The ideal candidate will have excellent technical skills, strong problem-solving abilities,...

  • Data Governance and Legal Expert

    3 days ago

    Delhi, Delhi, India Talent Worx Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Here is on the lookout for a Data Governance and Legal Expert to provide specialized expertise in data management practices combined with a deep understanding of legal compliance and data protection regulations. This role requires a proactive approach to developing and implementing data governance strategies that align with legal requirements, ensuring the...

  • Business Intelligence Expert

    2 days ago

    Delhi, Delhi, India beBeeDataAnalysis Full time ₹ 5,00,000 - ₹ 9,00,000

    Business Intelligence Expert RoleThis is a remote contract role for a Business Intelligence expert. The successful candidate will be responsible for daily tasks such as analyzing data, conducting data analytics, utilizing statistics, and communicating findings.ResponsibilitiesAnalyze large datasets to identify trends and patternsDevelop and implement...

  • GTM and Analytics Expert

    7 days ago

    Delhi, Delhi, India Spiralyze Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    GTM and Analytics ExpertDepartment: AnalyticsEmployment Type: Full TimeLocation: Remote India (Delhi)Description We're looking for someone great to join our Analytics Team Your primary task is to help internal and external clients add (complex) tracking and fix issues that arise.  You will take extreme amounts of initiative and enthusiasm to get stuff...