
Senior Big Data Technologist
2 days ago
We are seeking a highly skilled and experienced professional to join our team as a Data Software Engineer.
Key Responsibilities:- Develop, optimize, and maintain big data pipelines using Apache Spark and Python.
- Implement distributed computing solutions and large-scale data processing.
- Build and maintain stream-processing systems using Spark Streaming or Apache Storm.
- Integrate data from diverse sources including RDBMS (SQL Server, Oracle), ERP systems, and file-based sources.
- Work with messaging systems like Kafka or RabbitMQ.
- Develop and optimize SQL queries, stored procedures, and database schemas.
- Utilize NoSQL databases such as HBase, Cassandra, and MongoDB.
- Perform performance tuning of Spark jobs and queries.
- Use cloud-native services (AWS, GCP, or Azure Databricks) for scalable data solutions.
- Design and implement end-to-end Big Data solutions in agile environments.
- Provide technical leadership and mentor junior engineers.
- 5+ years of experience in Big Data & related technologies.
- Expert-level proficiency in Apache Spark.
- Hands-on Python programming experience.
- Cloud experience with at least one of AWS, Azure Databricks, or GCP.
- Experience with Apache Kafka or similar messaging platforms.
- Familiarity with Hadoop v2, HDFS, MapReduce, Sqoop.
- Experience in ETL frameworks and data ingestion pipelines.
- Proficient in SQL, data modeling, and working with structured/unstructured data.
- Good knowledge of Hive, Impala, and other big data querying tools.
- Exposure to Agile methodologies.
- Strong analytical and problem-solving skills.
- Ability to lead teams and manage stakeholders.
- Certifications in cloud platforms are a plus.
-
Senior Big Data Python Developer
1 day ago
Chennai, Tamil Nadu, India Innovatz Global Full time US$ 90,000 - US$ 1,20,000 per yearCompany DescriptionInnovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts, Project...
-
Senior Big Data Administrator
2 days ago
Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Administration Expert">This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of nodes per cluster. As a Big Data Administration expert, you will be responsible for performing comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka,...
-
Senior Big Data Engineer
1 day ago
Chennai, Tamil Nadu, India Luxoft Full time US$ 1,04,000 - US$ 1,30,878 per yearProject descriptionWe've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .ResponsibilitiesChoosing the right technologies for our use cases, deploy and operate.Setting up Data stores...
-
Senior Data Technologist
3 days ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878Job TitleWe are seeking a highly skilled Data Engineer to join our team.The ideal candidate will have experience in data technology and be proficient in Google Cloud Platform, GKE, Big Data, Streaming Integrations.A strong understanding of programming languages such as Java, Python, and Scala is also required.ResponsibilitiesParticipate and collaborate with...
-
Senior Big Data Professional
3 hours ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Expert WantedWe're seeking a seasoned Big Data professional with expertise in Java or Python to take on this exciting challenge.The ideal candidate will have a strong background in designing and implementing large-scale data processing systems, coupled with a solid understanding of modern data technologies.Design, develop, and maintain scalable Big...
-
Senior IT Manager: Big Data Solutions
4 days ago
Chennai, Tamil Nadu, India beBeeExperience Full time ₹ 33,121We are seeking a senior manager to lead our development team under finance and tax departments.Key Responsibilities:Requirements analysis and engineeringEnd-to-end development covering analysis, design, development, data management, devops integration using pipeline build and maintenance, solutioning for other non-functional requirementsInfrastructure...
-
Senior Big Data Developer
7 days ago
Chennai, Tamil Nadu, India beBeeDatabricksDeveloper Full timeBig Data Developer OpportunityAbout the RoleWe are seeking a skilled developer to design, build, and manage big data processing and analytics solutions using PySpark within the Databricks platform. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert...
-
Senior Big Data Engineer
2 days ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Platform EngineerAt our organization, we are building a world-class big data platform to bring value out of data for us and for our customers.We aim to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.Our mission is to build scalable, available,...
-
Chennai, Tamil Nadu, India Seven Consultancy Full timeJOB DETAILS Food Technologist with Minimum 4 - 5 Years' Experience.Shoulder have worked in New Product Development. Should know the nuances of New Product Development.Food Industry Preferred (Spice Industry added advantage)Male Candidate preferred.Willing to Travel (to our factory in Erode for Industrialization). FUNCTIONAL AREA Senior Food Technologist,...
-
Highly Experienced Big Data Strategist
2 days ago
Chennai, Tamil Nadu, India beBeeBigDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000Senior Big Data ArchitectJob Description:We are seeking a seasoned Senior Big Data Architect to lead the design, development and deployment of industry-leading big data and AI applications. As a key member of our team, you will be responsible for providing architectural guidance that fosters the adoption of Databricks across business-facing functions.Key...