Big Data Engineer

3 weeks ago

BangaloreChennaiPune, IN ADVANSOFT Full time

We are hiring for Data engineer with top most MNC client;

Exp : 5+years

Np : immediate to 15days

Location : & Responsibilities :


- 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.

- Experience working with Databases like Oracle, and Netezza and have strong SQL knowledge.

- Developing scalable streaming solutions based on Hadoop/ Big Data stack such as HDFS, Ozone, Hive/ Impala, Apache Spark, and Kafka.

- Experience in Data Engineering and implementation. multiple e end-to-end DW projects in a Big Data environment.

- Experience in building data pipelines through Git, Shell, Spark with Java/ Python on Hadoop, or Object storage (S3/CEPH).

- Strong analytical skills are required for debugging production issues, providing root causes, and implementing mitigation plans.

- Strong communication skills, both verbal and written and strong relationship, collaboration skills, and organizational skills.

- Flexible enough to stretch and work in India time to coordinate with the India team.

Experiences :

- Nice to have development experience in Python-based Al/ML workloads on Hadoop.

- Experience working on Nifi, APLS, and Unix Environments will be an added advantage.

- Experience of working in Agile teams.

- Ability to multi-task across multiple projects, interface with external and internal resources, and provide technical leadership to junior team members.

- Ability to be high-energy, detail-oriented, proactive, and able to function under pressure in an independent environment along with a high degree of initiative and self-motivation to drive results.

- Ability to quickly learn and implement new technologies and perform POC to explore the best solution for the problem statement.

- Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.

- Perform assigned tasks and production incidents independently.

(ref:hirist.tech)

  • Big Data Engineer

    7 days ago

    Mumbai/Bangalore/Pune, IN Techno Wise Full time

    Job Role : Big Data EngineerRelevant Experience : 3+ yearsLocation : Navi Mumbai /Bengaluru/PuneNotice Period : Immediate or serving Notice PeriodPrimary Skills : Big Data, PySpark, Cloud- Azure or AWS, Databricks, SQL, PythonOverview : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a...

  • Big Data Engineer

    2 months ago

    Bangalore/Chennai/Pune, IN ADVANSOFT Full time

    We are hiring for Data engineer with top most MNC client;Exp : 5+yearsNp : immediate to 15daysLocation : & Responsibilities : - 5+ years of working experience in ETL scalable data pipeline usin61Scala, Python, Pyspark, Hadoop, Apache Spark, Spark SQL, Kafka, Nill, and incremental Data Load with Big data technologies.- Experience working with Databases like...

  • Senior Big Data Engineer

    3 weeks ago

    Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Senior Big Data Engineer

    2 months ago

    Bangalore/Pune, IN Recrud Full time

    Senior Big Data Engineer Position. Experience Required: 6 -10 Years. Employment Type: Full-Time. About Our Client:. Our client is a distinguished product engineering consulting firm based in Bangalore, dedicated to providing innovative offshore development solutions. With over half a century of combined expertise in product engineering and consulting...

  • Big Data Engineer

    7 days ago

    Mumbai/Pune/Bangalore, IN Techno Wise Full time

    Job Description : We are seeking a talented Big Data Engineer proficient in PySpark to join our dynamic team. The ideal candidate will play a pivotal role in designing, implementing, and maintaining scalable data solutions leveraging the Big Data technologies like PySpark. This role requires a strong understanding of big data technologies, data engineering...

  • Big Data Developer

    2 weeks ago

    Bangalore/Pune, IN Xcelyst Full time

    Big Data + Scala developer Experience : 4-8 Yrs. experience overallMandatory Skills :Programming Languages : Scala (SCALA IS MAND)Big Data Frameworks : Spark, Hadoop/HDFS/Hive/Sqoop/Oozie, Kafka, HBase or any other NoSQL StoreGood to Have : Streaming with Spark/Kafka, Cloud knowledge (AWS/Azure)Scheduling and creatinLocation : Bangalore / PuneNotice Period :...

  • Data Architect

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN Blanket Technologies Full time

    Responsibilities :- Lead a team of data engineers in designing and implementing scalable data solutions. - Collaborate with data scientists to understand data requirements and ensure data integrity. - Develop and maintain data pipelines for efficient data processing. - Data Quality and Governance - Handling customer sensitive ( PII ,GDPR,HIPAA ) with...

  • Data Architect

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN Blanket Technologies Full time

    Responsibilities :- Lead a team of data engineers in designing and implementing scalable data solutions. - Collaborate with data scientists to understand data requirements and ensure data integrity. - Develop and maintain data pipelines for efficient data processing. - Data Quality and Governance - Handling customer sensitive ( PII ,GDPR,HIPAA ) with...

  • Publicis Sapient

    3 weeks ago

    Bangalore/Gurgaon/Gurugram, IN Publicis Sapient Full time

    Job Description :As Manager, Data Engineering, you will be responsible for translating client requirements into design, architecting, and implementing Azure Cloud based big data solutions for clients. Your role will be focused on delivering high quality solutions by independently driving design discussions related to Data Ingestion, Transformation &...

  • Lead Data Engineer

    1 month ago

    Chennai/Bangalore/Hyderabad, IN Cynosure Corporate Solutions Full time

    Job Description :- 10+ years of design & development experience with big data technologies like Azure, AWS or GCP- Preferred is Azure & Databricks, with experience in Azure DevOps- Experience in data visualizing technology in DL, like PowerBI- Proficient in Python, PySpark and SQL- Proficient in querying and manipulating data from various DB (relational and...

  • Lead Data Engineer

    3 weeks ago

    Chennai/Bangalore/Hyderabad, IN Cynosure Corporate Solutions Full time

    Job Description :- 10+ years of design & development experience with big data technologies like Azure, AWS or GCP- Preferred is Azure & Databricks, with experience in Azure DevOps- Experience in data visualizing technology in DL, like PowerBI- Proficient in Python, PySpark and SQL- Proficient in querying and manipulating data from various DB (relational and...

  • Big Data/Databricks Developer

    2 weeks ago

    Bangalore/Pune, IN Xcelyst Full time

    Big Data + Data Bricks DeveloperExperience : 5-8Years- 3+ Years in Big Data Engineer/Min 1 yr in DatabricksNotice Period : Immediate - 30 Days Location : Bangalore / PuneSkills : - Experience in Big Data/Hadoop Ecosystem. Hands on experience in Spark and Hive. Mandatory in DatabricksData Pipeline Development : Design, develop, and maintain scalable and...

  • Big Data Quality Assurance Engineer

    2 months ago

    Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • Big Data Quality Assurance Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Leadway Resource Full time

    We are seeking a highly skilled and experienced Big Data QA Engineer to join our team. You will play a critical role in ensuring the quality of our big data platform and data solutions. You will leverage your expertise in Big Data testing methodologies, automation frameworks, and scripting languages to design, develop, and execute comprehensive test...

  • Big Data Developer

    2 months ago

    Gurgaon/Gurugram/Bangalore, IN Workassist.in Full time

    Our hiring partner is looking for :- This is a full-time on-site role for a Big Data Developer at Big Four Consulting Firm Gurugram.- The Big Data Developer will be responsible for tasks related to Data Engineering, Extract Transform Load (ETL), Big Data, Data Warehousing, and Software Data Engineering, Big Data, Extract Transform Load (ETL), and Data...

  • Big Data Engineer

    3 weeks ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Engineer

    2 months ago

    Any Location/Bangalore, IN Careerfit.ai Full time

    Responsibilities :Solution Design :- Design, develop, and maintain scalable big data solutions and data pipelines for efficient data ingestion, processing, storage, and analysis.- Collaborate with data scientists, analysts, and business stakeholders to identify data requirements, use cases, and business objectives.- Translate business needs into technical...

  • Big Data Solutions Engineer

    4 weeks ago

    Bangalore/Any Location, IN Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team.- The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients.- The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • Big Data Solutions Engineer

    3 weeks ago

    Bangalore/Any Location, IN Gethyr Full time

    Our company is seeking a talented Big Data Solutions Engineer to join our team.- The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution for our clients.- The candidate will work closely with the software development team, data scientists, and product managers to understand...

  • AWS Data Architect

    2 months ago

    Bangalore/Chennai/Gurgaon/Gurugram/Hyderabad/Pune, IN Huquo Full time

    Role Description: Data Engineer - Big Data The ideal candidate is a hands-on technology developer with experience in developing scalable applications and platforms. They must be at ease working in an agile environment with little supervision. The person should be a self-motivated person with a passion for problem solving and continuous learning. Role and...