
Big Data Professional
3 days ago
Job Title: Data Architect
The company is seeking a highly skilled individual to design and develop large-scale data pipelines and distributed data processing systems. The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka.
Key Responsibilities:
- Develop efficient queries and perform data analysis using Jupyter Notebooks and SQL.
- Collaborate with cross-functional teams to design scalable cloud-based data architectures.
- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
Mandatory Skills:
- Strong expertise in Spark (PySpark) and Python.
- Hands-on experience with Apache Kafka.
- Knowledge of NiFi / Airflow for orchestration.
- Scala – Minimum 3+ years of hands-on experience.
- Strong experience in Distributed Data Systems (5+ years).
Preferred Skills:
- Familiarity with Splunk or other monitoring/alerting solutions.
- Exposure to messaging technologies like Apache Kafka or equivalent.
This opportunity offers the chance to contribute to the growth and success of the organization through meaningful work.
-
Big Data Expert
3 days ago
Kannur, Kerala, India beBeeBigData Full time ₹ 18,00,000 - ₹ 30,00,000We're seeking a seasoned Data Scientist to spearhead our Big Data initiatives. As a key member of our team, you will have the opportunity to work with cutting-edge technologies and drive business growth through data-driven insights.About the Role:Design, develop, and implement scalable Big Data solutions using PySpark and Hive.Collaborate with...
-
Big Data Engineer
2 weeks ago
Kannur, Kerala, India Nice Software Solutions Pvt. Ltd. Full timeBig Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...
-
Big Data Engineer Role
2 days ago
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000Senior Data Engineer - Big Data and AnalyticsWe are seeking a highly skilled Senior Data Engineer to lead the development of big data and analytics environments on Databricks.Main Responsibilities:Design, build, and maintain complex technical architectures on Databricks, ensuring scalability, reliability, and performance.Develop and implement efficient data...
-
Big Data Architect
3 days ago
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Opportunity: Big Data ArchitectThe Senior Data Engineer position involves designing, building, and maintaining large-scale data architectures. This includes data lakes, lakehouses, and warehouses.Key Responsibilities:Create scalable real-time and batch processing workflows using PySpark and Apache Spark.Cleanse, transform, deduplicate, normalize, encode,...
-
Big Data Specialized Solutions Expert
2 days ago
Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking a seasoned Data Specialist to lead our Big Data endeavors.Our ideal candidate will have extensive experience in handling large-scale data platforms and be proficient in leveraging tools such as PySpark, Hive, and Spark. Additionally, they should possess knowledge of HBase and DQ tool for efficient data ingestion and processing.The successful...
-
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000ThreatXIntel is a startup cyber security company that offers customized solutions to protect businesses from cyber threats.We are seeking an experienced Freelance Data Engineer with expertise in data pipelines design and development.Design and develop ETL/ELT pipelines using PySpark, AWS, and Databricks for large-scale data integration.Perform data...
-
**Senior Data Engineering Professional
13 hours ago
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000**Job Opportunity:** Data EngineerWe are seeking a highly skilled professional to join our team as a key member of the engineering team. The selected candidate will be responsible for designing, building, and maintaining production-level data pipelines that handle large-scale datasets.The ideal candidate will work closely with AI/ML teams to support model...
-
Data Architect
3 days ago
Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Big Data Architect RoleEffective data processing is a critical aspect of any organization. As such, we seek an experienced professional to fill the role of Big Data Architect.Key Responsibilities:Design and implement scalable data architectures using Apache Spark and related tools.Configure and maintain data pipelines for seamless data flow.Develop and...
-
Experienced Big Data Solutions Architect
5 days ago
Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000Our client seeks a highly skilled Senior Data Engineer to join their team. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability,...
-
Chief Data Architect
2 days ago
Kannur, Kerala, India beBeeDataEngineer Full time US$ 1,50,000 - US$ 2,00,000Job Title: Senior Data EngineerAt our organization, we are looking for a highly skilled Big Data Engineer to join our Professional Services team. This role is critical in ensuring our data infrastructure can handle increasing volumes of data while maintaining exceptional performance standards.The successful candidate will design, build, and maintain...