Senior Big Data Technologist

2 days ago


Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
Job Title: Data Software Engineer

We are seeking a highly skilled and experienced professional to join our team as a Data Software Engineer.

Key Responsibilities:
  • Develop, optimize, and maintain big data pipelines using Apache Spark and Python.
  • Implement distributed computing solutions and large-scale data processing.
  • Build and maintain stream-processing systems using Spark Streaming or Apache Storm.
  • Integrate data from diverse sources including RDBMS (SQL Server, Oracle), ERP systems, and file-based sources.
  • Work with messaging systems like Kafka or RabbitMQ.
  • Develop and optimize SQL queries, stored procedures, and database schemas.
  • Utilize NoSQL databases such as HBase, Cassandra, and MongoDB.
  • Perform performance tuning of Spark jobs and queries.
  • Use cloud-native services (AWS, GCP, or Azure Databricks) for scalable data solutions.
  • Design and implement end-to-end Big Data solutions in agile environments.
  • Provide technical leadership and mentor junior engineers.
Required Skills & Qualifications:
  • 5+ years of experience in Big Data & related technologies.
  • Expert-level proficiency in Apache Spark.
  • Hands-on Python programming experience.
  • Cloud experience with at least one of AWS, Azure Databricks, or GCP.
  • Experience with Apache Kafka or similar messaging platforms.
  • Familiarity with Hadoop v2, HDFS, MapReduce, Sqoop.
  • Experience in ETL frameworks and data ingestion pipelines.
  • Proficient in SQL, data modeling, and working with structured/unstructured data.
  • Good knowledge of Hive, Impala, and other big data querying tools.
  • Exposure to Agile methodologies.
Preferred Qualifications:
  • Strong analytical and problem-solving skills.
  • Ability to lead teams and manage stakeholders.
  • Certifications in cloud platforms are a plus.


  • Chennai, Tamil Nadu, India Innovatz Global Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionInnovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts, Project...


  • Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Administration Expert">This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of nodes per cluster. As a Big Data Administration expert, you will be responsible for performing comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka,...


  • Chennai, Tamil Nadu, India Luxoft Full time US$ 1,04,000 - US$ 1,30,878 per year

    Project descriptionWe've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .ResponsibilitiesChoosing the right technologies for our use cases, deploy and operate.Setting up Data stores...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job TitleWe are seeking a highly skilled Data Engineer to join our team.The ideal candidate will have experience in data technology and be proficient in Google Cloud Platform, GKE, Big Data, Streaming Integrations.A strong understanding of programming languages such as Java, Python, and Scala is also required.ResponsibilitiesParticipate and collaborate with...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Expert WantedWe're seeking a seasoned Big Data professional with expertise in Java or Python to take on this exciting challenge.The ideal candidate will have a strong background in designing and implementing large-scale data processing systems, coupled with a solid understanding of modern data technologies.Design, develop, and maintain scalable Big...


  • Chennai, Tamil Nadu, India beBeeExperience Full time ₹ 33,121

    We are seeking a senior manager to lead our development team under finance and tax departments.Key Responsibilities:Requirements analysis and engineeringEnd-to-end development covering analysis, design, development, data management, devops integration using pipeline build and maintenance, solutioning for other non-functional requirementsInfrastructure...


  • Chennai, Tamil Nadu, India beBeeDatabricksDeveloper Full time

    Big Data Developer OpportunityAbout the RoleWe are seeking a skilled developer to design, build, and manage big data processing and analytics solutions using PySpark within the Databricks platform. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Platform EngineerAt our organization, we are building a world-class big data platform to bring value out of data for us and for our customers.We aim to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.Our mission is to build scalable, available,...


  • Chennai, Tamil Nadu, India Seven Consultancy Full time

    JOB DETAILS Food Technologist with Minimum 4 - 5 Years' Experience.Shoulder have worked in New Product Development. Should know the nuances of New Product Development.Food Industry Preferred (Spice Industry added advantage)Male Candidate preferred.Willing to Travel (to our factory in Erode for Industrialization). FUNCTIONAL AREA Senior Food Technologist,...


  • Chennai, Tamil Nadu, India beBeeBigDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data ArchitectJob Description:We are seeking a seasoned Senior Big Data Architect to lead the design, development and deployment of industry-leading big data and AI applications. As a key member of our team, you will be responsible for providing architectural guidance that fosters the adoption of Databricks across business-facing functions.Key...