
Big Data Engineer
1 week ago
Role: Big Data Engineer
Exp: 4 - 8 Years
Mode of Work: On-site
Employment Type: Full-time
Location: KochiJob Description
Design, develop, and maintain scalable and efficient big data processing pipelines distributed computing systems
Collaborate with cross-functional teams to understand data requirements and design appropriate data solutions.
Implement data ingestion, processing, and transformation processes to support various analytical and machine learning use cases.
Optimize and tune data pipelines for performance, scalability, and reliability.
Monitor and troubleshoot pipeline performance issues, identifying and resolving bottlenecks.
Ensure data quality and integrity throughout the pipeline, implementing data validation and error handling mechanisms.
Stay updated on emerging technologies and best practices in big data processing and analytics, incorporating them into our data engineering practices.
Document design decisions, technical specifications, and data workflows.
Mandatory Qualification:
Bachelor's degree in computer science, Engineering, or related field. Master's degree preferred.
Proven experience (3+ years) as a Data Engineer or similar role, with a focus on big data processing.
Strong proficiency in programming languages such as Python, Java, & Scala.
Experience with big data processing frameworks and technologies such as Apache Hadoop, Spark, Kafka, Flink, etc.
Hands-on experience with distributed computing, parallel processing, and cloud-based data platforms (e.g., AWS, Azure, Google Cloud).
Proficiency in SQL and database technologies (e.g., SQL Server, PostgreSQL, MySQL).
Experience with data warehousing, ETL (Extract, Transform, Load) processes, and data modeling.
Familiarity with containerization technologies (e.g., Docker, Kubernetes) and DevOps practices.
Excellent problem-solving skills and attention to detail.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Tools and Technologies:
IDEs: IntelliJ IDEA, Eclipse
Build Tools: Maven, Gradle
Testing Frameworks: JUnit, Mockito, TestNG
Containerization: Docker, Kubernetes
API Documentation: Swagger, OpenAPI
Monitoring and Logging: Prometheus, Grafana, ELK Stack
Database: MySQL, PostgreSQL, MongoDB, Redis
ORM Frameworks: Hibernate, Spring Data
Message Brokers: Kafka
-
Data Engineer
2 weeks ago
Cochin, Kerala, India Prevalent AI Full time ₹ 5,00,000 - ₹ 15,00,000 per yearRole purpose Are you passionate about cutting-edge technology and big data? At Prevalent AI, we're at the forefront of building innovative solutions to handle petabyte-scale data. As a Data Engineer, you will play a pivotal role in supporting the development of key data engineering components for our Data Fabric and Exposure Management products.In this...
-
Data Engineer PostGres and DataBricks
1 week ago
Cochin, Kerala, India DBiz ai solutions Full time ₹ 6,00,000 - ₹ 18,00,000 per yearDbiz is a high-performing product and engineering company that partners with organizations to build digital solutions using the right technology at the right time. We pride ourselves on our innovative approach, leveraging technology in diverse and impactful ways.We are looking for an Experienced Data Engineer with a strong background in DataBricks or...
-
Senior Data engineer
2 weeks ago
Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole Overview: Seeking an experienced Senior Data Engineer to lead data ingestion, transformation, and optimization initiatives using the modern Apache and Azure data stack. The role involves working on scalable pipelines, large-scale distributed systems, and data lake management. Core Responsibilities:Build and manage high-volume data pipelines using...
-
Lead Data Engineer – AWS
2 weeks ago
Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Location: KochiRemoteTrivandrumJob PurposeWe are seeking an experienced Senior Data Engineer to lead the development of a scalable data ingestion framework while ensuring high data quality and validation. The successful candidate will also be responsible for designing and implementing robust APIs for seamless data integration. This role is ideal for...
-
Data Architect
4 days ago
Cochin, Kerala, India Milestone Technologies, Inc. Full time ₹ 6,00,000 - ₹ 18,00,000 per yearData Architect Job Summary:We are looking for a seasoned and visionary Data Architect with over 14 years of experience to lead the design and implementation of enterprise-grade data architecture, governance frameworks, and scalable data platforms. This role requires deep expertise in modern data technologies, big data ecosystems, and cloud-native solutions....
-
Data Architect
2 weeks ago
Cochin, Kerala, India Litmus7 Systems Consulting Full time ₹ 20,00,000 - ₹ 25,00,000 per yearData Architect is responsible to define and lead the Data Architecture, Data Quality, Data Governance, ingesting, processing, and storing millions of rows of data per day. This hands-on role helps solve real big data problems.You will be working with our product, business, engineering stakeholders, understanding our current eco-systems, and then building...
-
Senior Data Engineer
3 days ago
Cochin, Kerala, India Experion Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Location: KochiRemoteTrivandrumExperience5+ YearsJob PurposeWe are seeking an experienced Senior Big Data Engineer to take a leading role in designing, building, and managing the data driven apps for one of our customers. You will be responsible for understanding evolving customer needs and translating them into robust, scalable, and cost-effective data...
-
Data Scientist
1 week ago
Cochin, Kerala, India Simelabs - Digital, AIML, Automation, Robotics, Gen AI. Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking a passionate and innovativeAI/ML Engineerto join our team and drive cutting-edge AI solutions across traditional machine learning, deep learning, and generative AI. If you enjoy solving complex problems, experimenting with the latest AI technologies, and building real-world applications, we'd love to connect.Key ResponsibilitiesDesign,...
-
Documentation Engineer
1 week ago
Cochin, Kerala, India BIG Security Networks Full time ₹ 6,00,000 - ₹ 12,00,000 per yearJob Title:Documentation Engineer: (ELV/Telecom Systems)Location:Kochi, KeralaEmployment Type:Full-timEWe are seeking a detail-oriented Documentation Generation Engineer to manage, prepare, and maintain all project documentation for our TELECOM/ELV (Extra Low Voltage) systems, including TELECOM/IT/CCTV, Access Control, Public Address, Fire Alarm, BMS, and...
-
Data Architect
3 days ago
Cochin, Kerala, India Milestone Technologies Full time ₹ 10,00,000 - ₹ 25,00,000 per yearCompany OverviewMilestone Technologies is a global IT managed services firm that partners with organizations to scale their technology, infrastructure and services to drive specific business outcomes such as digital transformation, innovation, and operational agility. Milestone is focused on building an employee-first, performance-based culture and for over...