Current jobs related to Big Data Engineer - Bangalore - Draup
-
Data Engineer
1 month ago
Bangalore, India Coders Brain Technology Private Limited Full timeQualifications : - Bachelor's degree in Computer Science/Engineering or similar - 5-7 years of data engineering experience with focus on designing and implementing scalable big data transformations and pipelines - Proficiency with Cloud Platforms like Azure(preferred), AWS, and/or Google cloud, including knowledge of core services like Azure: Data...
-
Cloud big data engineer
2 weeks ago
Bangalore, India Lakshya Software Technologies Pvt. Ltd. Full timeTitle: Cloud Big Data Engineer Exp - 5+ years Location: Anywhere in India Work Mode: HYBRID Mandatory Skills required: Big Data (Hadoop, Hive), Python, Spark, Py Spark, Cloud Platform, Azure Job description: Understanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic Search ...
-
Big Data Engineer
2 months ago
Bangalore, India Eximietas Design Full time6+ years of experience in Big data engineering with a focus on data pipeline setup and management. ● Strong development experience in Java ● Hands-on experience with Kafka , S3, CDC, Spark, and SQL. ● Proficient with container technologies like Docker. ● Experience working in cloud environments and handling large datasets. ● Solid...
-
Big data engineer
2 weeks ago
Bangalore, India Capco Full timeJob Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+ clients...
-
Senior Data Engineering
1 month ago
Bangalore, India FxConsulting Full timeJob Title : Lead Data EngineerWe are seeking a highly skilled Lead Data Engineer with expertise in Big Data technologies to join our dynamic team. As a Lead Data Engineer, you will play a pivotal role in designing, building, and optimizing large-scale data pipelines and systems to drive business insights and innovation.Key Responsibilities : - Design,...
-
Cloud Big Data Engineer
2 weeks ago
Bangalore, India Lakshya Software Technologies Pvt. Ltd. Full timeTitle: Cloud Big Data Engineer Exp - 5+ years Location: Anywhere in India Work Mode: HYBRID Mandatory Skills required: Big Data (Hadoop, Hive), Python, Spark, PySpark, Cloud Platform, Azure Job description: Understanding of Big data Ecosystem with hands on experience working on Apache Spark, Hadoop (HDFS , Hive), Parquet, Elastic Search ...
-
Big data developer
2 weeks ago
Bangalore, India Impetus Full timeBig Data Developer Experience- 3 to 12 years Locations- Indore, Noida, Hyderabad, Bangalore, Gurgaon Job Description We are looking for a Big Data Developer to design and oversee the implementation of large-scale data solutions, lead a talented team, and ensure the efficient processing and analysis of massive datasets. Roles &...
-
Big Data Engineer
2 weeks ago
Bangalore, India Capco Full timeJob Title: Big Data Engineer About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount . With our presence across 32 cities across globe, we support 100+...
-
Solution Engineer
1 month ago
Bangalore, India HEVO DATA Full timeOverview :. We're seeking a talented Solutions Engineer with strong background in Data Domain to join our growing Sales team. You'll work one-on-one with the sales team to help discover our customers' business and technical needs and demonstrate how Hevo's platform can solve their real-time data replication needs. In this role, you will...
-
Data Scientist/Engineer
4 days ago
Bangalore/Remote, India Skima Innovations Pvt ltd Full timeAbout the Company : We are a stealth company revolutionizing the marketing landscape with our AI-powered platform. Our team has pioneered AI-based marketing systems at some of the most iconic companies in the world including Expedia, Amazon, Snapchat, and BCG to transform how businesses direct their marketing spend to drive unprecedented growth and...
-
Big Data Developer
1 hour ago
Bangalore, India Recro Full timeJob Title : Big Data Engineer (Python & PySpark) Location : Bangalore Experience : 5+ years Key Responsibilities : Develop scalable data pipelines using Python and PySpark . Build and optimize Apache Spark jobs for data transformation and aggregation. Work with Big Data tools: Hadoop , HDFS , Hive , Kafka , and large...
-
Big data engineer with devops
2 weeks ago
Bangalore, India Damco Solutions Full timePosition – Big Data Engineer with Devops Exp - 6-10 Yrs Job Location- Bangalore ( 3 days hybrid working ) Job Description As a Software Development Engineer you will be responsible for expanding and optimizing our data and data pipeline architecture as well as optimising data flow and collection for cross-functional teams. The ideal candidate...
-
Chennai/Bangalore, India Globalemployees Full timeAbout UsGlobalemployees is a cutting-edge technology company that leverages the power of big data to drive innovation.Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a key member of our engineering team, you will design, build, and maintain large-scale data processing systems using cloud-based technologies like...
-
Big data platform engineer
2 weeks ago
Bangalore, India Prodapt Full timeRoles and Responsibilities: Understand the requirements from Cloud user (Developers/Data scientists/Data analysts) and work with platform/infra teams to onboard their solutions in Big Query or Data Proc platforms. Create BQ datasets, Compute projects, Hive tables, GCS buckets and Service accounts etc. Grant access to BQ datasets, GCS buckets and Hive...
-
Big Data Developer
1 month ago
Bangalore, India LTIMindtree Full timePlease fill this form for quick responses ;- If it is not able to access please past it on Google and try to fill it... Link:- Role:- Big Data Developer/ Big Data Engineer Skills:- Pyspark, Sql, Hive, Exp:- 5 + Years Loc:- Bengaluru, NCR Noida, Gurugram, Delhi Mode;- Hybrid Regards, Dhamodhar. G TA
-
Draup - Big Data Engineer - Spark/Python
1 month ago
Bangalore, India Draup Full timeRole : Big Data EngineerJob Description :The Big Data Engineer at Draup is responsible for building scalable techniques and processes for data storage, transformations, and analysis. The role includes designing, and implementation of the optimal, generic, and reusable data-platforms and pipelines. You will work with a very proficient, inquisitive,...
-
Senior Data Engineer
1 month ago
Bangalore, India Visionyle Solutions Full timeTitle : Senior Data EngineerExperience : 6+ YearsNotice Period : Immediate to 15 Days (Serving NP candidates)Work Location - BangaloreMandatory skills : Big data applications, Spark, python, scala , AWS S3,Airflow,Data bricks, data platforms, Jenkins, CICD PipelinesRequirements :- 6+ years of experience in developing scalable Big Data applications or...
-
Big Data Developer
3 months ago
Bangalore City, India Tata Consultancy Services Full timeGreetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...
-
Big data specialist
2 weeks ago
Bangalore, India LTIMindtree Full timePlease fill this form for quick response:- Please fill this: - if it is not opening you can paste it on google and fill it. Experience Range - 5 to 12 yrs Skills - Big Data- Scala Spark Job Location: Bangalore, Chennai, Pune, Hyderabad, Mumbai Scala Spark Job Description: Mainly Scala+Spark ex perience needed. 5+ years of experience ...
-
Recro | Big Data Developer
2 hours ago
bangalore, India Recro Full timeJob Title: Data Engineer – Python, PySpark, Big DataLocation: (Onsite)Experience: (5+ years)Job Description:Seeking an experienced Data Engineer with expertise in Python, PySpark, and Big Data technologies to design and build scalable data solutions on the Google Cloud Platform (GCP).Responsibilities:Develop/optimize data pipelines using Python and...
Big Data Engineer
2 months ago
Job Title: Big Data Engineer
About the Role:
The Big Data Engineer at Draup is responsible for designing and implementing scalable techniques and processes for data storage, transformations, and analysis. This role involves building generic and reusable data platforms and pipelines. You will work with a team of experienced developers, engineers, and product team members to shape up data products.
Key Responsibilities:
- Design and develop scalable architectures for data storage, transformations, and analysis.
- Work on data engineering projects to ensure pipelines are reliable, efficient, testable, and maintainable.
- Develop solutions that are scalable, generic, and reusable.
- Build and execute data warehousing, data mining, and data modeling activities using agile development techniques.
- Lead and take ownership of big data projects from scratch to production.
Requirements:
- Proficient understanding of big data and distributed systems principles.
- Good programming experience in Python.
- Proficiency in Apache Spark (PySpark) is a must.
- Experience in developing ETL and ELT solutions in a scalable way from multiple data sources.
- Understanding of technologies like Relational and NoSQL datastores.
- Working and conceptual knowledge of MapReduce, HDFS, Amazon S3.
- Ability to code and think in functional programming paradigm.
- Enthusiasm for optimizing code performance and resources of the system.
What We Offer:
- Expertise in big data infrastructure, distributed systems, data modeling, query processing, and relational databases.
- Experience in designing big data solutions with Spark/HDFS/MapReduce/Flink.
- Familiarity with different file-storage formats like Parquet, ORC, Avro, Sequence files, etc.
- Knowledge of cluster managers like YARN, Spark Standalone, Mesos, or Kubernetes, etc.
- Strong knowledge of data structures and algorithms.
- Ability to apply technologies to solve big data problems and develop innovative big data solutions.
Who We Are Looking For:
- B.E / B.Tech / M.E / M.Tech / M.S in Computer Science or software engineering.
- Experience of 2-6 years working with Big Data technologies.
- Willingness to work with terabytes and petabytes of data on a daily basis.