Big Data Engineer
3 days ago
Job Description Our Company Changing the world through digital experiences is what Adobe's all about. We give everyonefrom emerging artists to global brandseverything they need to design and deliver exceptional digital experiences We're passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen. We're on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours The Opportunity Join Adobe in the heart of Bengaluru, where brand-new engineering meets outstanding innovation. As a Data Engineer, you will play a pivotal role in crafting the future of digital experiences. This is an outstanding opportunity to be part of a dynamic and ambitious team dedicated to developing a data platform, data pipelines, reports, and analysis. Your work will be instrumental in delivering powerful technology that empowers users globally. What you will do - Build a data platform using big data processing and warehousing technologies. - Build, maintain, and ideate on frameworks and tools required to ingest, store, process and serve data for global scale, data-intensive systems. - Build data pipelines to publish reports and to power dashboards for ALM clients. - Collaborate with cross-functional teams to determine key interfaces for your projects and build them with quality and agility. - Do analysis and present key findings, insights and concepts to key influencers and leaders to help them make data driven decisions on business and product roadmap. - Support Machine Learning engineers and Data Scientists with their dataset needs for training the ML or statistical models and evaluating them. - Be aware of the latest open-source projects and technological breakthroughs in the data engineering space and explore them to build better and more effective solutions. - Drive innovation through research and experimentation, encouraging an environment where new ideas can thrive. - Mentor junior engineers on the team What you need to succeed - A bachelor's degree in computer science or related fields. - 8-12 years of experience as a server-side developer, with at least 4 years in Data Engineering, with a consistent track record of designing, implementing, and delivering large scale, high-quality solutions. - Solid understanding and programming skill in languages such as Java or Python and frameworks and libraries based on them with a focus on data engineering. - Strong expertise and familiarity with various Big Data technologies and frameworks including Delta Lake, Apache Hive, Datahub, Apache Spark, Apache Flink, Apache Storm, Trino, and AWS EMR. - Strong familiarity with the concepts of RDBMS, Data Lake, Data Warehouse, Data Lakehouse, and Medallion Architecture. - Knowledge of at least one workflow orchestration tools such as Airflow or Oozie. - Experience working with ML engineers, Data Scientists, product and engineering leadership on their data and analysis needs. - Experience working with the DevOps teams to drive operationally excellent infrastructure. - Excellent problem-solving skills, with a consistent track record of delivering innovative solutions. - Ability to thrive in a collaborative, inclusive, and diverse workplace, embracing different perspectives and ideas. - Being comfortable with the ambiguity and having the ability to adapt to evolving priorities. - Be a role model and a mentor for the team by doing diligent code and design reviews, by doing knowledge sharing sessions and showcasing sound technical decision making in day-to-day work. - Being ahead of the curve by familiarizing yourself with the latest and the best in the technological landscape and turning them into effective solutions for our customers. Adobe is proud to be an Equal Employment Opportunity employer. We do not discriminate based on gender, race or color, ethnicity or national origin, age, disability, religion, sexual orientation, gender identity or expression, veteran status, or any other applicable characteristics protected by law. Learn more. Adobe aims to make Adobe.com accessible to any and all users. If you have a disability or special need that requires accommodation to navigate our website or complete the application process, email [Confidential Information] or call (408) 536-3015.
-
Big Data Engineer
4 weeks ago
Bengaluru, India Acme Services Full timeJob Description We are actively seeking a skilled Big Data Engineer to join our client's dynamic team through Acme Services. This pivotal role requires solid experience in ETL / Data Engineering / Data Warehousing principles. The ideal candidate will possess strong proficiency in Python, PySpark, and SQL or other ETL tools, along with hands-on experience in...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per yearJob Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...
-
Big Data Engineer
2 weeks ago
Bengaluru, India Whatjobs IN C2 Full timeJob Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...
-
Big Data Engineer
2 weeks ago
Bengaluru, India Tata Consultancy Services Full timeJob Title :- Data Engineer - Pyspark Experience: 5 to 8 Years Location: Pune/Hyderabad Job Description Required Skills: 5+ years of experience in Big data and pyspark Must-Have Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL Good-to-Have Good Spark, Pyspark,Big Data experience Spark UI/Optimization/debugging techniques...
-
Big Data Engineer
2 weeks ago
Pune, India Coforge Full timeJob Description Coforge Ltd is Hiring for Big Data Engineer AWS, Spark & Scala. Must Have Skills:- AWS, Spark & Scala. Experience Required: 3 to 6 Years Job Locations: Pune, Hyderabad, Greater Noida Only. Send your CV to: [Confidential Information] For queries, contact via WhatsApp: 9667427662 Key Responsibilities:- Design, develop, and optimize Big Data...
-
Big Data
4 weeks ago
Bengaluru, India Teamware Solutions Full timeJob Description Teamware Solutions is seeking a talented and passionate Big Data Engineer with 2-4 years of experience to join our dynamic team. This role is crucial for designing, developing, implementing, and troubleshooting scalable Big Data solutions that process, store, and manage large volumes of diverse data. The successful candidate will contribute...
-
Big Data Engineer
5 hours ago
Bengaluru, Karnataka, India Acme Services Full time ₹ 5,00,000 - ₹ 15,00,000 per yearWe are looking for Big Data Engineer who has experience with:- 1) Big Query 2) Pyspark 3) GCP or AWS or Azure Required Candidate profileCandidate should have more than 5 Years of overall experience in Data Engineer. We are not looking for Data Analyst or Snowflake Developer.
-
Big Data Engineer
1 week ago
Bengaluru, Karnataka, India Akshya Patra Services Full time ₹ 5,00,000 - ₹ 25,00,000 per yearWe are looking for a skilled Big Data Engineer with expertise in various Big Data tools and ecosystems. The ideal candidate should have hands-on experience with technologies such as Hadoop, Spark, Hive, and Impala. A strong proficiency in programming languages like Scala, Java, and Python is essential for designing and implementing data processing...
-
Big Data Engineer
2 weeks ago
Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per yearBig Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...
-
Big Data Engineer
4 weeks ago
Hyderabad, Bengaluru, India Fusion Plus Solutions Full timeJob Description We are looking for a skilled Big Data Engineer with 5 to 7 years of hands-on experience in Big Data technologies. The ideal candidate should have strong expertise in Hadoop, HDFS, Hive, SQL, and Unix, and be able to work on large-scale data processing systems. Roles and Responsibilities: - Work on design, development, and optimization of Big...