Senior Big Data Integration Specialist

2 weeks ago

Cochin, Kerala, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000
Job Opportunity: Data Engineer

We are seeking a skilled and experienced Apache NiFi Developer/Data Engineer to join our team.

The ideal candidate will have a strong background in data engineering, ETL processes, and data integration, with hands-on experience in designing, developing, and managing data pipelines using Apache NiFi.

This role involves working closely with cross-functional teams to ensure seamless data flow, transformation, and delivery across our systems.

Key Responsibilities:

  • Design, develop, and maintain scalable and efficient data pipelines using Apache NiFi.
  • Integrate data from multiple sources, including databases, APIs, cloud storage, and streaming platforms.
  • Optimize data workflows for performance, reliability, and scalability.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Troubleshoot and resolve issues related to data ingestion, transformation, and delivery.
  • Implement data security and governance best practices within NiFi workflows.
  • Monitor and maintain NiFi clusters, ensuring high availability and performance.
  • Document data pipelines, workflows, and processes for future reference and knowledge sharing.
  • Stay up-to-date with the latest trends and advancements in Apache NiFi and data engineering technologies.

Qualifications:

  • Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent experience).
  • Proven experience working with Apache NiFi to build and manage data pipelines.
  • Strong understanding of ETL/ELT processes and data integration concepts.
  • Proficiency in working with various data formats (e.g., JSON, XML, CSV) and protocols (e.g., HTTP, FTP, Kafka).
  • Experience with relational databases (e.g., MySQL, PostgreSQL) and NoSQL databases (e.g., MongoDB, Cassandra).
  • Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
  • Knowledge of scripting languages (e.g., Python, Bash) for automation and customization.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and collaboration skills.

Preferred Skills:

  • Experience with big data technologies (e.g., Hadoop, Spark).
  • Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).
  • Familiarity with data governance and compliance standards (e.g., GDPR, HIPAA).
  • Certification in Apache NiFi or related technologies is a plus.

  • Senior Big Data Expert

    2 weeks ago

    Cochin, Kerala, India beBeeDataengineer Full time ₹ 15,00,000 - ₹ 28,00,000

    Data Engineer PositionWe are seeking an experienced Data Engineer to lead our data engineering efforts. Job Description:As a Senior Big Data Expert, you will be responsible for designing and implementing large-scale data processing systems using technologies such as Apache Spark, Hadoop, and cloud-based platforms like Azure, AWS, or GCP.Required Skills and...

  • Unlock the Power of Big Data: Senior Data Engineer Wanted

    2 weeks ago

    Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerThis role involves designing, developing and maintaining large-scale data systems. We are seeking an experienced professional who can lead our data engineering efforts.Key Responsibilities:Developing and implementing data pipelines using PythonCollaborating with cross-functional teams to integrate data systems with cloud platforms,...

  • Senior Big Data Administrator

    1 week ago

    Cochin, Kerala, India beBeeDataiku Full time ₹ 10,00,000 - ₹ 23,45,678

    Big Data Administrator Job Description">We are seeking a highly skilled Big Data Administrator to manage our big data platform. This is an exciting opportunity for experienced professionals to work with cutting-edge technology and contribute to the success of our organization.">The ideal candidate will have extensive knowledge of Hadoop, Hive, HBase, and...

  • Big Data Architect

    2 weeks ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,93,16,340 - ₹ 2,11,60,520

    Job OverviewYour potential, unleashed.India's impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realise your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond.At Deloitte, your whole self to work, every day. Combine that...

  • Senior Cloud and Big Data Engineer

    2 weeks ago

    Cochin, Kerala, India beBeeBigData Full time ₹ 15,90,000 - ₹ 23,45,000

    Cloud and Big Data Architect Role OverviewOur company is looking for a skilled Cloud and Big Data Architect to join our team in Bengaluru. As a key member of our Digital & Data Solutions (DDS) department, you will be responsible for designing and implementing cloud-based solutions that leverage big data technologies.We are committed to creating a diverse...

  • Data Integration Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeIntegration Full time US$ 7,50,000 - US$ 15,00,000

    Job Opportunity: Data Integration SpecialistWe're seeking a skilled professional to help our clients harness the power of data for digital transformation and long-term sustainability.Our team has extensive experience in operational technology (OT) and IT, spanning over a century and 60 years respectively.As a Data Integration Specialist, you'll be...

  • Data Integration Specialist

    1 week ago

    Cochin, Kerala, India beBeeETLDeveloper Full time ₹ 20,00,000 - ₹ 30,00,000

    About the RoleWe are seeking a skilled Data Integration Specialist to join our team. The ideal candidate will be responsible for designing, developing, and maintaining data integration processes, as well as data warehouse design and modeling, to support our business intelligence initiatives.This role requires proficiency in T-SQL, Azure Data Factory (ADF),...

  • Big Data Analytics Expert

    2 weeks ago

    Cochin, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewThe Role of a Big Data DeveloperThis is an exciting opportunity to work with big data, leveraging technologies like Scala, AWS, and Python or Java. ResponsibilitiesAnalyzing large datasets to gain valuable insightsDeveloping and maintaining scalable data processing systemsEnsuring data quality and integrityMust have experience in handling big...

  • Senior Big Data Hadoop Scala Specialist

    2 weeks ago

    Cochin, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job DescriptionWe are seeking a seasoned professional to lead our big data initiatives. As a Big Data Hadoop Scala expert, you will be responsible for designing and implementing scalable data processing solutions.

  • Big Data Specialist

    7 days ago

    Cochin, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineer - Big Data Job Description:Lead Infrastructure Implementation: We are seeking an experienced professional to lead the implementation of infrastructure using code. The successful candidate will provide strategic advice and recommendations for Microsoft Azure technologies based on research trends in public cloud environments.Integrate...