
Big Data Expert
22 hours ago
As a Big Data Expert, you will play a vital role in designing and developing scalable data infrastructure to support our organization's growth.
• Design and implement robust data pipelines that ingest, process, and transform data from various sources into usable formats.
• Collaborate with cross-functional teams to understand data requirements and deliver high-quality data solutions.
• Develop and maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.
• Ensure compliance with data privacy regulations and industry standards.
• Optimize data pipelines and queries for improved performance and efficiency.
• Identify and resolve bottlenecks in data processing.
Technical Requirements:
• Proficiency in Python is essential. Experience with SQL for database querying and manipulation is also required. Knowledge of Java or Scala is a plus.
• Hands-on experience with big data frameworks such as Apache Spark, Hadoop, or Flink.
• Strong experience with at least one major cloud provider's data services (AWS, GCP, or Azure).
• Deep expertise in relational databases (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Cassandra).
• Experience with modern data warehouses (Snowflake, Redshift, BigQuery) is highly preferred.
• Understanding of data governance principles and experience with implementing security measures like encryption, access controls, and data masking.
• Proficiency with Git for version control.
• Experience with Docker and Kubernetes is a plus.
-
Big Data Administrator
7 days ago
Chennai, Tamil Nadu, India beBeeAdministrator Full time ₹ 80,00,000 - ₹ 1,20,00,000Job TitleWe are seeking an experienced Big Data Administrator to lead our team in the development and maintenance of large-scale data systems.">Key Responsibilities:Design, deploy and manage Cloudera clusters for efficient data processing.Migrate data between various systems ensuring seamless integration.Optimize system performance through advanced...
-
Senior Big Data Administrator
6 days ago
Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Administration Expert">This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of nodes per cluster. As a Big Data Administration expert, you will be responsible for performing comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka,...
-
Big Data Engineer
4 weeks ago
Chennai, Tamil Nadu, India Impetus Career Consultants Private Limited Full timeWe are hiring for one the IT big4 consulting.Location : Req : - AWS (Big Data services) S3, Glue, Athena, EMR.- Programming Python, Spark, SQL, Mulesoft,Talend, Dbt.- Data warehouse ETL, Redshift / Responsibilities : - Work with business stakeholders to understand their business needs.- Create data pipelines that extract, transform, and load (ETL) from...
-
Senior Big Data Professional
4 days ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Big Data Expert WantedWe're seeking a seasoned Big Data professional with expertise in Java or Python to take on this exciting challenge.The ideal candidate will have a strong background in designing and implementing large-scale data processing systems, coupled with a solid understanding of modern data technologies.Design, develop, and maintain scalable Big...
-
Senior Big Data Developer
1 week ago
Chennai, Tamil Nadu, India beBeeDatabricksDeveloper Full timeBig Data Developer OpportunityAbout the RoleWe are seeking a skilled developer to design, build, and manage big data processing and analytics solutions using PySpark within the Databricks platform. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert...
-
Big Data Expert
7 days ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Seeking a skilled professional to fill a key role in our organizationThe ideal candidate will possess expertise in managing and analyzing large datasets using various tools and technologiesKey responsibilities include:• Designing and implementing data pipelines to ensure seamless data flow• Developing and maintaining scalable data architectures•...
-
Senior Big Data Technologist
6 days ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Software EngineerWe are seeking a highly skilled and experienced professional to join our team as a Data Software Engineer.Key Responsibilities:Develop, optimize, and maintain big data pipelines using Apache Spark and Python.Implement distributed computing solutions and large-scale data processing.Build and maintain stream-processing systems...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Insight Global Full timePosition: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...
-
Big Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India beBeeBigDataEngineer Full timeJob Title: Big Data EngineerWe are seeking a highly skilled and experienced Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data processing systems using Hadoop.Responsibilities:• Design, develop, and deploy big data solutions using Hadoop, Spark, and Scala.•...
-
Senior Big Data Systems Developer
6 days ago
Chennai, Tamil Nadu, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title:Data Software Engineer\About the Role:This is an opportunity to design and implement large-scale data systems, develop real-time processing solutions, and optimize data workflows across multiple platforms.\\Design and implement scalable big data systems\Develop real-time processing solutions\Optimize data workflows across multiple...