Big Data Specialist
1 day ago
We are seeking a highly skilled professional with expertise in Big Data technologies and AWS Cloud Services. The ideal candidate will bring strong hands-on experience in designing, architecting, and implementing scalable data engineering solutions while driving innovation within the team.
- Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
- Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
- Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).
- Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
- Work on real-time streaming solutions using Kafka and AWS Kinesis.
- Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
- Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
- Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
- Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
- Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.
Mandatory Skills & Qualifications:
- Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop and Spark Mandatory)
- Proven expertise in Spark with Scala
- Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)
-
Big Data Specialist
4 days ago
Hubli, Karnataka, India beBeeDataScientist Full time ₹ 60,00,000 - ₹ 1,20,00,000Job OverviewThe role involves working with large-scale data sets utilizing Big Data tools and technologies. We are looking for a skilled professional to join our team as a Data Scientist.Key Responsibilities:Develop, tweak queries, and work on performance enhancement using Scala, Spark, Hive, and Hadoop Big Data Eco System Tools.Apply SQL experience to...
-
Big Data Specialist
1 week ago
Hubli, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Seeking a skilled professional to fill a Big Data positionJob Overview:We are looking for an experienced individual with expertise in processing and analyzing large datasets.Key Responsibilities:Data Ingestion: Design and implement efficient data ingestion processes from diverse sources onto our Big Data platformData Processing: Utilize PySpark, Hive, and...
-
Big Data Systems Engineer
1 day ago
Hubli, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000Job Title:Data Engineering SpecialistAbout the Role:We are seeking a highly skilled Data Engineering Specialist to join our team. The ideal candidate will have a strong background in data engineering and experience with designing, building, and maintaining large-scale data systems.Key Responsibilities:Create and maintain events/streaming based...
-
Expert Big Data Management Specialist
5 hours ago
Hubli, Karnataka, India beBeeDataAdministrator Full time ₹ 1,65,00,000 - ₹ 2,21,00,000Big Data AdministratorThe ideal candidate will have experience in Hadoop, Hive, HBase, and BigSQL.Manage day-to-day operations of the Big Data Platform.Administer and monitor Big Data Platform components, including Hadoop, Hive, HBase, and BigSQL.Key responsibilities include:Creating encryption zones, managing encryption keys, and copying data between...
-
Big Data Engineering Expertise
1 week ago
Hubli, Karnataka, India beBeeDataEngineering Full time US$ 1,00,000 - US$ 1,50,000Job Title: Big Data Engineering ExpertiseAbout the Role:As a seasoned big data engineer, you will be responsible for designing, building, and maintaining high-performance data pipelines that process vast amounts of data.Key Responsibilities:
-
Senior Big Data Engineer
1 day ago
Hubli, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 2,00,000Big Data ExpertOur client is seeking an experienced Big Data expert to join their team. The ideal candidate will have extensive knowledge of Big Data technologies and Google Cloud Platform services.Design, develop and optimize data pipelines using GCP BigQuery Dataflow and Apache Airflow to support large-scale data analytics.Utilize the Big Data Hadoop...
-
Senior Big Data Architect
2 days ago
Hubli, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Big Data Engineer PositionJob Summary:We are seeking a highly skilled Big Data Engineer to design and implement scalable data transformation pipelines using Snowflake and dbt, following industry-accepted best practices.Key Responsibilities:Data Pipeline Development: Design and implement robust ELT pipelines using dbt on Snowflake, ensuring scalability and...
-
Data Engineering Specialist
4 days ago
Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 24,00,000 - ₹ 40,00,000Job Title: Data Engineering SpecialistWe are seeking a seasoned data engineering specialist to lead our organization's data warehousing, big data, and data analytics initiatives.Total years of experience: 9+ Years required for this position.The ideal candidate should have extensive skills and success in the implementation of technology projects within a...
-
Big Data Technology Architect
9 hours ago
Hubli, Karnataka, India beBeeDataPlatform Full time ₹ 1,00,00,000 - ₹ 2,00,00,000About the JobWe are seeking a skilled Data Platform Leader to drive the development of our Enterprise TruRisk Platform. The successful candidate will be responsible for delivering roadmap features, collaborating with engineers and architects, and providing technical leadership on data platform design.Job Responsibilities:Lead the thought process in data...
-
Cloud Architect
4 days ago
Hubli, Karnataka, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Description:We are looking for skilled and passionate experts to join our team at Bengaluru. This is a full-time hybrid role offering flexibility for remote work.Key Responsibilities:Design Big Data architecture, cloud adoption strategies, and solutions.Migrate on-premises applications and databases to the cloud.Ensure data governance and applicative...
