Current jobs related to Lead Big Data Engineering Solutions Specialist - Kannur, Kerala - beBeeDataEngineer
-
Big Data Analytics Specialist
1 week ago
Kannur, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job DescriptionWe are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in data analytics and experience working with big data platforms.As a Big Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with...
-
Big Data Specialist
2 weeks ago
Kannur, Kerala, India beBeeData Full time ₹ 14,61,120 - ₹ 20,98,960Big Data SpecialistWe are seeking a skilled professional to join our team. In this role, you will be responsible for designing and developing scalable data processing systems using big data technologies.Main Responsibilities:Develop software applications using Java, Scala, and other programming languages.Design and implement data pipelines using Apache Spark...
-
Big Data Platform Specialist
2 weeks ago
Kannur, Kerala, India beBeeDataiku Full time ₹ 20,00,000 - ₹ 30,00,000About People Prime Worldwide:We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.Job Title: Big Data Platform SpecialistLocation: KannurExperience: 7 to 10 YearsEmployment Type: Contract to HireWork Mode: HybridNotice Period: Immediate...
-
Chief Big Data Engineer
2 weeks ago
Kannur, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000Job RoleWe seek a seasoned expert in big data to lead our team. This individual will have extensive experience with pySpark, Hadoop, and Hive.ResponsibilitiesCreate efficient pipelines using cloud-based technologies and adhere to industry best practices.Conduct thorough integration testing and provide estimates for development, deployment, and quality...
-
Advanced Big Data Architect Role
2 weeks ago
Kannur, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Lead Big Data Engineer">We are seeking a talented technical leader to deliver roadmap features of Enterprise TruRisk Platform. This is a fantastic opportunity to be an integral part of a team building Qualys next generation platform using Big Data & Micro-Services based technology.">Key Responsibilities">Be the thought leader in data platform and pipeline...
-
Lead Data Engineer
2 weeks ago
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job SummaryWe are seeking a highly skilled Python Data Engineer to lead our on-premise data engineering efforts.This is an exceptional opportunity for a seasoned professional to leverage their expertise in designing, developing, and optimizing ETL pipelines using tools like Apache Nifi, Talend, or Pentaho.Main Responsibilities:ETL Development & Optimization:...
-
Senior Data Solutions Specialist
2 weeks ago
Kannur, Kerala, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Key Role: Big Data EngineerWe are seeking a skilled professional to develop and implement big data solutions. A successful candidate will have experience in designing, building, and optimizing large-scale data pipelines using distributed data systems and cloud-based technologies.Design and create high-performance data processing systems.Develop expertise in...
-
Advanced Data Solutions Specialist
2 weeks ago
Kannur, Kerala, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Big Data Engineer Position">We are seeking a highly skilled professional with expertise in designing, architecting, and implementing scalable data engineering solutions.">Key Responsibilities:">">Design and develop Big Data architectures leveraging cloud services for large-scale data processing.">Build and maintain data pipelines using Spark (Scala) for both...
-
Cloud Data Engineering Specialist
2 weeks ago
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 14,00,000Role OverviewThe ideal candidate will possess a strong foundation in data engineering, with experience working with cloud-based services and Python. They should be proficient in big data processing concepts and have expertise in designing and implementing scalable data pipelines.Key ResponsibilitiesDevelop and deploy efficient data processing algorithms...
-
Data Architectural Specialist
1 week ago
Kannur, Kerala, India beBeeCloudComputing Full time ₹ 45,00,000 - ₹ 85,00,000Job DescriptionWe are seeking a highly skilled and experienced Senior Software Engineer/Technical Specialist to join our team.The successful candidate will be responsible for developing and optimizing ETL/ELT pipelines using Azure Data Factory (ADF), Databricks, and Synapse Analytics. They will also design and implement scalable data architectures following...
Lead Big Data Engineering Solutions Specialist
2 weeks ago
We are seeking a skilled Data Engineer to lead the development of big data engineering solutions. The successful candidate will work closely with clients and team members to understand their requirements and develop architectures that meet their needs.
The role involves developing data pipelines for new sources, data transformations within the Data Lake, implementing GraphQL, working on NoSQL databases, CI/CD, and data delivery as per business requirements.
Key Responsibilities:
- Develop pipelines to bring in a wide variety of data from multiple sources within the organization as well as from social media and public data sources.
- Collaborate with cross-functional teams to source data and make it available for downstream consumption.
- Work with the team to provide an effective solution design to meet business needs.
- Ensure regular communication with key stakeholders, understand any key concerns in how the initiative is being delivered or any risks/issues that have either not yet been identified or are not being progressed.
- Elevate dependencies and challenges (risks) and manage them accordingly.
- Manage timelines (milestones, decisions, and delivery) to ensure value of initiative is achieved without compromising quality.
- Coordinate communications plans for initiative execution and delivery, both internal and external.
- Hand over initiative to business-as-usual processes and conduct post-implementation review to ensure objectives have been delivered and lessons learned are fed into future initiative management processes.
Required Skills and Qualifications:
- Excellent problem analysis skills.
- Good experience in Azure Databricks platform.
- Experience with at least one Cloud Infra provider (Azure/AWS).
- Knowledge of Apache Spark Structured Streaming or Apache Flink on Kafka & Delta Lake.
- Knowledge of NOSQL databases and experience in Cosmos DB, Restful APIs, and GraphQL.
- Experience with Hive and Hadoop file formats (Avro / Parquet / ORC).
- Basic knowledge of scripting (shell / bash).
- Experience of working with multiple data sources including relational databases (SQL Server / Oracle / DB2 / Netezza), NoSQL / document databases, flat files.
- Basic understanding of CI CD tools such as Jenkins, JIRA, Bitbucket, Artifactory, Bamboo, and Azure Dev-ops.
- Ability to debug, fine-tune, and optimize large-scale data processing jobs.
