Big Data Engineer
1 month ago
Job Description :
Key Responsibilities :
- Develop and maintain scalable data pipelines using Python, PySpark, and Scala.
- Work with Big Data streaming services such as Kinesis, Kafka, and others to process and analyze large data sets.
- Manage and optimize NoSQL data stores such as HBase and DynamoDB.
- Utilize Hadoop and Big Data processing frameworks like Spark, Hive, Nifi, Spark-Streaming, and Flink for data processing and transformation.
- Collaborate with cross-functional teams to participate in key business, architectural, and technical decisions.
- Write and optimize complex SQL queries and use SQL analytical functions for data analysis.
Qualifications :
- Industry Experience : 5+ years, including 3+ years of relevant experience in Big Data technologies.
- Programming Skills : Proficient in Python, PySpark, and Scala (preferred).
- Big Data Tools : Experience with Big Data streaming services (Kinesis, Kafka) and processing frameworks (Spark, Hive, Nifi, Spark-Streaming, Flink).
- Database Skills : Experience with NoSQL data stores (HBase, DynamoDB) and SQL databases with strong SQL analytical skills.
- Problem-Solving : Ability to participate in and contribute to key business, architectural, and technical decisions.
Additional Requirements :
- Strong communication and collaboration skills.
- Ability to work in a fast-paced, dynamic environment.
- Early joiners who can start in May are preferred
-
Data Engineer
1 month ago
Bangalore, Karnataka, India Coders Brain Technology Private Limited Full timeQualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...
-
Senior Data Engineering
1 month ago
Bangalore, Karnataka, India FxConsulting Full timeJob Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...
-
Solution Engineer
1 month ago
Bangalore, Karnataka, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will have...
-
Draup - Big Data Engineer - Spark/Python
1 month ago
Bangalore, Karnataka, India Draup Full timeRole : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for building scalable techniques and processes for data storage, transformations, and analysis. The role includes designing, and implementation of the optimal, generic, and reusable data-platforms and pipelines. You will work with a very proficient, inquisitive,...
-
Senior Data Engineer
1 month ago
Bangalore, Karnataka, India Visionyle Solutions Full timeTitle : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...
-
Senior Software Engineer
4 months ago
Bangalore, Karnataka, India Talpro Full timeJob Description :Key Responsibilities :Design and Development :- Architect, design, and develop scalable and high-performance data platforms.- Implement data ingestion, transformation, and processing pipelines using technologies such as Apache Kafka, Hadoop, Spark, and Flink.- Develop real-time data processing and stream processing applications.Data...
-
Big Data Engineer
1 month ago
Bangalore, Karnataka, India Tavant Full timeKey Responsibilities :- Design and implement scalable and efficient data processing pipelines using Apache Spark and Java.- Develop APIs and services for data ingestion, transformation, and aggregation to support analytics and machine learning models.- Collaborate with data scientists, analysts, and cross-functional teams to understand data requirements and...
-
Big Data Engineer
4 weeks ago
Bangalore, Karnataka, India TekPillar Full timePosition : Big Data EngineerExperience : 4 to 7 YearsLocation : BangaloreMandatory Skills: Hadoop , Hive , Spark , Python , SQL , AWS/Azure , AirflowJob Description :- 4-6 years of relevant experience with a bachelor's degree- Exposure to Satellite/Telecom industries- Proven leadership in large data engineering initiatives- Proficiency in Big Data tools...
-
Platform Architect
4 months ago
Bangalore, Karnataka, India Talpro Full timeEducational Qualification : - BE./ B.Tech., M./M.Tech. or M.Sc. in Computer Science from Tier 1 university Skill Set :- 10+ years of experience in end-to-end software development and system architecture, preferably in a product development organisation- Hands-on experience in Java and Big Data tech stack - Apache Pinot/Druid/Hudi, HDFS, Hive, Presto, Flume,...
-
Big Data Engineer
1 month ago
Bangalore, Karnataka, India TEAMLEASE DIGITAL PRIVATE LIMITED Full timeJob Title : Data EngineerLocation : Bangalore / HyderabadJob Type : Full-timeWork Arrangement : 4 days a week in the office, 1 day remoteExperience Level : 4+ yearsRole Overview : We are seeking an experienced Data Engineer with a strong background in Hadoop, MapReduce, and Java. The ideal candidate will have a proven track record of handling large-scale...
-
Big Data Engineer/Lead
4 weeks ago
Bangalore, Karnataka, India TekPillar Full timeJoin our dynamic team in Bangalore as a Big Data Engineer contribute to our key data engineering initiatives! You will play a crucial role in managing and prioritizing projects while driving strategies and executing data engineering solutions.Job Title : Big Data Engineer/ LeadExperience : 4 to 9 YearsLocation : BangaloreKey Responsibilities : - Collaborate...
-
Bangalore, Karnataka, India Altimetrik Full timeRole : Data engineer - Good understanding of AWS Data Stack including services like S3, Redshift, EMR, Lambda, Athena and Glue. Good understanding of Hadoop/HDFS- Designing and developing ETL jobs across multiple platforms- Designing and developing schema definitions and support data warehouse/mart to enable integration of disparate data sources from within...
-
Big Data Engineer
1 month ago
Bangalore/Hyderabad, Karnataka, India VIDPRO CONSULTANCY SERVICES Full timeThis position will be a part of a growing team working towards building world class large scale Big Data architectures. This individual should have a sound understanding of programming principles, experience in programming in Java, Python or similar languages and can expect to spend a majority of their time coding. Experience : 4-7 Years. Location :...
-
Big Data Engineer
1 month ago
Bangalore, Karnataka, India MaimsD Technology Full timeJob Title : Big Data DeveloperExperience : 4-7 yearsLocation : BengaluruJob Type : Full-TimeJob Description : About the Role : As a Big Data Developer, you will be responsible for designing, developing, and maintaining applications that process and analyze large datasets. You will work closely with data analysts, data scientists, and other team members to...
-
Publicis Sapient
1 month ago
Bangalore, Karnataka, India Publicis Sapient Full timeSenior Associate Data Engineering Level 2The Senior Associate People Senior Associate L2 in Data Engineering, you will translate client requirements into technical design, and implement components for data engineering solution. Utilize deep understanding of data integration and big data design principles in creating custom solutions or implementing package...
-
Lead Big Data Engineer
4 weeks ago
Bangalore, Karnataka, India TekPillar Full timeJob Title : Senior Data Engineer (Big Data)Experience : 4-9 YearsLocation : BangaloreJob Overview : We are seeking a skilled Senior Data Engineer to coordinate with cross-functional teams, manage and prioritize projects, and drive key data engineering initiatives. The successful candidate will have a deep understanding of big data tools and the ability to...
-
Aiprus Software
1 month ago
Bangalore, Karnataka, India Aiprus Software Private Limited Full timeCompany Description :Aiprus Software Private Limited is an onshore-offshore based IT outsourcing company formed in March 2021, specializing in providing professional, cost-effective offshore outsourcing services globally. The company offers a full range of IT services, including Application Development, Testing, Production Support, and Product & Solution...
-
Robosoft Technologies
3 weeks ago
Bangalore, Karnataka, India Robosoft Technologies Full timeExperience :- Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 3+ years in data-related AWS Cloud services.- Have 3+ year of experience in ClickHouse or any other OLAP system.- Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions.- Expert in...
-
Hadoop Developer
1 month ago
Bangalore, Karnataka, India SAPBOT Technologies Full timeJob Description : Opportunity for Hadoop Developer. Experience : 5 to 10 yrs Relevant. Notice Period : Immediate 15 Days. Location : Bangalore. JD : - 5+ years of data warehousing/engineering, software solutions design and development experience. - Experience in designing and architecting distributed data systems. - Code, test, and document new or modified...
-
Big Data Developer
1 month ago
Bangalore, Karnataka, India Ekfrazo Technologies Private Limited Full timeWe are hirinig for L3 Big data developer. Experience : 4+ Yrs. Location : Bangalore. Notice period : 15 Days/ Immediate. Job description :- Design, develop, and implement highly scalable and distributed big data solutions using Hadoop ecosystem technologies such as HBase, Hive, Kudu, and Spark. - Architect HBase schemas and data models to accommodate...