Senior Big Data Engineer

4 weeks ago

BangalorePune, IN Recrud Full time

Senior Big Data Engineer Position.

Experience Required: 6 -10 Years.

Employment Type: Full-Time.

About Our Client:.

Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions.

With over half a century of combined expertise in product engineering and consulting services across global markets, they have a proven track record of facilitating growth for US startups and multinational corporations.

The Opportunity:

We are thrilled to announce the formation of a new offshore product development team on behalf of our partner.

This team is at the forefront of developing cutting-edge Big Data and Cloud-Based Business Operation Support technologies tailored for the utilities and retail energy sectors, as well as Community Choice Aggregators (CCA).

The successful candidate will join a team of elite data engineers based in the US, contributing to the expansion of the data engineering division and working across various products and infrastructure layers.

Role Overview:

The role calls for a skilled Big Data Engineer responsible for constructing and overseeing Big Data Pipelines, managing extensive structured datasets to produce accurate analytics at scale.

Key responsibilities include selecting optimal solutions for data management, implementing, and monitoring these solutions, and ensuring seamless integration within the company's architecture.

Candidates should demonstrate a strong passion for precision engineering, efficiency, and the ability to work both collaboratively and independently with minimal supervision.

Key Responsibilities:

- Collaborate with Product Management and Engineering teams to develop and implement the optimal solutions.

- Engage in design discussions and brainstorming sessions to choose, integrate, and maintain Big Data tools and frameworks to address large-scale data challenges.

- Design and deploy systems for cleaning, processing, and analyzing vast data sets using distributed processing tools such as Akka and Spark.

- Evaluate and enhance existing data pipelines in collaboration with Technical Leaders and Architects to resolve bottlenecks.

- Demonstrate initiative and a proactive approach to learning new technologies, contributing significantly as a Senior Individual contributor across multiple products and A minimum of 7 years' experience in developing scalable Big Data pipelines.

- Comprehensive knowledge of the Big Data ecosystem, including frameworks like Spark, Akka, Storm, Hadoop, and associated file types.

- Proficiency with ETL and Data pipeline tools such as Apache NiFi, Airflow, etc.

- Strong coding skills in Java or Scala, and familiarity with design patterns.

- Experience with Git and build tools such as Gradle/Maven/SBT.

- Solid grasp of object-oriented design, data structures, algorithms, and optimization techniques.

- Ability to write elegant, readable, maintainable, and extensible code.

Additional Skills:

- Excellent communication skills with the ability to articulate issues and solutions effectively.

- A strong sense of urgency, precision, and timeliness.

- Ability to work independently, manage multiple projects/tasks, and resolve issues efficiently.

- Passion for continuous learning, analysis, and troubleshooting.

Interested candidates are encouraged to apply, demonstrating how their skills and experience align with the role's requirements.

This is a unique opportunity to be part of a dynamic team, driving technological innovation in a thriving sector

(ref:hirist.tech)

  • Senior Data Engineer

    4 weeks ago

    Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...

  • Data Engineer

    4 weeks ago

    Bangalore/Pune, IN Pylon Management Consulting Full time

    Requirements:- Overall 5+ years of IT experience with 3+ years in data-related technologies.- Minimum 2.5 years of experience in Big Data technologies and working exposure in at least one cloud platform on related data services (AWS / Azure / GCP).- Hands-on experience with the Hadoop stack - HDFS, sqoop, Kafka, Pulsar, NiFi, Spark, Spark Streaming, Flink,...

  • Big Data Engineer

    4 weeks ago

    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...

  • AWS Data Engineer

    4 days ago

    Bangalore/Pune, IN Technomech Placements Full time

    This is a full-time hybrid role for a Senior AWS Data Engineer. The Senior AWS Data Engineer will be responsible for day-to-day tasks such as data engineering, data modeling, ETL (Extract Transform Load), data warehousing, and data analytics.Qualifications :- Data Engineering, Data Modeling, and ETL (Extract Transform Load) skills- Data Warehousing and Data...

  • Spark Engineer

    3 weeks ago

    Bangalore/Onsite In Bangalore, IN Cyber Sphere LLC Full time

    Job Description :As a Spark Engineer you will help customers to be successful with the Data Intelligence platform by resolving important technical customer escalations and the support team. You will be the technical bridge between support and engineering and the first line of defense for engineering. You will ensure that all issues are vetted by you before...

  • Big Data Quality Assurance Engineer

    4 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • Senior Data Engineer

    4 weeks ago

    Bangalore/Remote, IN Geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...

  • Big Data Developer

    4 weeks ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • Senior Java Big Data Engineer

    4 weeks ago

    Bangalore/Delhi, IN SavvyR Solutions Private Limited Full time

    Your primary focus will be writing clean, maintainable, and efficient Java code to extract, transform, and load massive datasets. You will also collaborate closely with data scientists, analysts, and other engineers to ensure our solutions meet business needs and deliver real value.Responsibilities :Design, develop, test, and deploy robust, scalable Java...

  • DigiHelic - Senior Data Architect - Big Data Technologies

    4 weeks ago

    Any Location/Bangalore/Chennai, IN Digihelic Solutions Pvt. Ltd. Full time

    Job Summary :We are seeking a highly skilled and motivated Product Solution Architect with extensive expertise in designing and implementing cutting-edge big-data solutions on the Amazon Web Services (AWS) platform.As a key member of our dynamic team, you will play a pivotal role in driving the success of our data-driven initiatives, leveraging AWS services...

  • Big Data Engineer

    4 weeks ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Engineer

    4 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Connectio IT Pvt Ltd Full time

    Key Skills : Java, Apache Spark, Apache Kafka, Hadoop, AWSJob Description :- Designing, installing, testing, and maintaining scalable data management systems- Ensuring systems meet business requirements and industry standards- Creating custom software components and analytics applications- Research data acquisition opportunities and new uses for existing...

  • Valiance Solutions

    4 weeks ago

    Noida/Bangalore/Mumbai, IN Valiance Analytics Pvt. Ltd. Full time

    About Us : Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team comprises...

  • Data Engineer

    2 weeks ago

    Pune/Hyderabad, IN Promaynaov Advisory Services Pvt Ltd Full time

    Role : Data EngineerLocation : Pune/HyderabadIn this role, you will : Principal Responsibilities :As a key member of the technical team alongside Engineers, Data Scientists and Data Users, you will be expected to define and contribute at a high-level to many aspects of our collaborative Agile development process - Software design, Scala & Spark development,...

  • Big Data Architect

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN ARR Recruitment Solutions Full time

    About the Role :- We are seeking a highly experienced Big Data Architect to join our team and lead the design, development, and implementation of our big data solutions.- This role is ideal for a candidate with a deep understanding of big data technologies and a proven track record of delivering scalable and robust big data architectures.Responsibilities :-...

  • Lead Data Engineer

    22 hours ago

    Chennai/Bangalore/Hyderabad, IN Cynosure Corporate Solutions Full time

    Job Description :- 10+ years of design & development experience with big data technologies like Azure, AWS or GCP- Preferred is Azure & Databricks, with experience in Azure DevOps- Experience in data visualizing technology in DL, like PowerBI- Proficient in Python, PySpark and SQL- Proficient in querying and manipulating data from various DB (relational and...

  • Senior Data Engineer

    4 weeks ago

    Bangalore/Kolkata/Pune, IN Nilasu consulting Full time

    Summary :- We are seeking a highly skilled and experienced Senior Data Engineer to join our team.- You will play a key role in designing, developing, and maintaining large-scale data processing pipelines using Python and Spark/PySpark.- Your expertise in distributed computing frameworks and DevOps tools will be instrumental in building efficient and scalable...

  • Senior Data Engineer

    4 weeks ago

    Hyderabad/Pune/Bangalore, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring Data Engineers for the leaders In Analytics & Cloud Applications, headquartered in San Francisco and have offices in India (Bangalore, Hyderabad and Pune).Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud...

  • Big Data Engineer

    3 weeks ago

    Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full time

    Hiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...