Big Data Developer

5 days ago

Bengaluru, India TecQubes Technologies Full time

Job Description :


Skillset : Azure, Scala, Spark, Pyspark, Hadoop, Hive

Location : Remote

Experience : 6+ Years

Job Description :


As a Big Data Engineer, you will be responsible for designing, developing, and maintaining big data solutions to support data-driven decision-making.

You will work with large datasets, implement data pipelines, and build data products.

Key Responsibilities :

- Design and develop scalable data pipelines using Apache Spark and other big data technologies.

- Extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.

- Design and implement data models to support business analytics and reporting.

- Perform data analysis and generate insights using SQL, Python, and other tools.

- Create data visualizations using tools like Tableau or Power BI.

- Leverage cloud platforms like AWS, Azure, or GCP to deploy and manage big data solutions.

- Utilize cloud-native services like EMR, Databricks, and Redshift.

- Identify and resolve performance bottlenecks in data pipelines and queries.

- Ensure data quality, consistency, and security.

Required Skills and Experience :


- Strong proficiency in Scala and Python programming languages.

- In-depth knowledge of Apache Spark and its core components (Spark SQL, Spark Streaming, Spark Core).

- Experience with big data technologies like Hadoop, Hive, and HBase.

- Expertise in data warehousing concepts and data modeling techniques.

- Proficiency in SQL and database technologies.

- Experience with cloud platforms (AWS, Azure, GCP) and cloud-native tools.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

Preferred Skills :


- Experience with machine learning and AI frameworks (e., TensorFlow, PyTorch).

- Knowledge of data visualization tools (e., Tableau, Power BI).

- Experience with real-time data processing and stream processing frameworks (e., Kafka, Flink)

(ref:hirist.tech)

  • Big Data Developer

    8 months ago

    Bengaluru, India Unison Consulting Pte Ltd Full time

    Job Description:Unison Consulting Pte Ltd is seeking an experienced Big Data Developer to join our team. As a Big Data Developer, you will be responsible for designing, developing, and maintaining big data solutions to enable data-driven decision making and analytics capabilities for our clients. You will work with large volumes of structured and...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Advent Global Solutions Full time

    Position : Big Data Developer/Big Data Senior DeveloperLocation : Chennai, Bangalore, Pune, Gurgaon, and MumbaiExperience : 5 to 14 yearsRelevant : should be 4+ yrs for Junior and 7+ yrs for SeniorPrimary skills : Spark, SQL,HiveDevelop and maintain architectures such as databases and large-scale processing systems using Python, Scala, SQL, and Unix...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 Years- Required Technical skills: Bigdata, Hadoop Technologies- 4+ years of experience in Big Data,...

  • Big data developer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India LTIMindtree Full time

    Please fill this form for quick responses ;-If it is not able to access please past it on Google and try to fill it...Link:- Big Data Developer/ Big Data EngineerSkills:- Pyspark, Sql, Hive,Exp:- 5 + YearsLoc:- Bengaluru, NCR Noida, Gurugram, DelhiMode;- HybridRegards,Dhamodhar. GTA

  • Big data developer

    3 weeks ago

    Bengaluru, India LTIMindtree Full time

    Please fill this form for quick responses ;-If it is not able to access please past it on Google and try to fill it...Link:- Lx Fw Yq9Role:- Big Data Developer/ Big Data EngineerSkills:- Pyspark, Sql, Hive,Exp:- 5 + YearsLoc:- Bengaluru, NCR Noida, Gurugram, DelhiMode;- HybridRegards,Dhamodhar. GTA

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • Big Data Developer

    3 weeks ago

    Greater Bengaluru Area, India Pixomania Full time

    Job Title: Big Data Developer (Scala + Spark)Location: RemoteExperience: 5+ yearsJob Type: Contractual RemoteAbout Us:We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and...

  • Big Data Developer

    3 weeks ago

    Greater Bengaluru Area, India Pixomania Full time

    Job Title: Big Data Developer (Scala + Spark)Location: RemoteExperience: 5+ yearsJob Type: Contractual RemoteAbout Us:We are a forward-thinking technology company committed to delivering innovative solutions in Big Data analytics. Join our talented team as a Big Data Developer with expertise in Scala and Apache Spark to drive impactful projects and...

  • Big Data Developer

    3 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring forBig Data DeveloperDesired Experience:5+ YearsJob Location:Chennai/ Bangalore / Pune / MumbaiRequire skillset:Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications:Data Engineer CertificationExperience with Apache Beam.Technical...

  • Big Data Developer

    4 months ago

    Bengaluru, India IBCScorp Full time

    Hi,We are hiring for Bigdata Developer for one of our Prestigious Client @ Bangalore Location. Job Location: BangalorePosition: Big Data DeveloperExperience: 5+yrsTotal YOE: 5+ Years Technical Experience 2+ Years of experience with Big Query SQL. 4+ years of experience with Scala and SPARK. Very strong in SQL 4+ yrs Experience with GCP Cloud. Candidate...

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Tata Consultancy Services Full time

    TCS has always been in the spotlight for being adept in "the next big technologies" What we can offer you is a space to explore varied technologies and quench your techie soul.Role: Big Data DeveloperLocation: Bangalore/Chennai/Hyderabad/PuneExperience:5-10 YearsRequired Technical skills: Bigdata, Hadoop Technologies4+ years of experience in Big Data,...

  • BIG DATA Developer

    1 month ago

    Bengaluru, India IBCScorp Full time

    Please see below the JD for Bigdata developer:Candidate should be available to interview in person in BangaloreWorking within a cross functional, agile development team, this Big Data Developer will be responsible for hands on development and technical delivery of innovative components used in data driven solutions.The candidate will have a sound working...

  • Big Data Developer

    3 weeks ago

    Bengaluru, India LTIMindtree Full time

    Please fill this form for quick responses ;- If it is not able to access please past it on Google and try to fill it... Link:- Role:- Big Data Developer/ Big Data Engineer Skills:- Pyspark, Sql, Hive, Exp:- 5 + Years Loc:- Bengaluru, NCR Noida, Gurugram, Delhi Mode;- Hybrid Regards, Dhamodhar. G TA

  • Big Data Developer

    4 weeks ago

    Bengaluru, India Luxoft Full time

    Project Description:The Cirrus project is developing cloud-based compliance state-of-the-art archive products to archive and retain real-time communications data in line with internal and external regulatory requirements. The product is developed in-house in an agile development setup, based on business requirements from multiple stakeholder parties. By...

  • Senior Big Data Developer

    2 months ago

    Bengaluru, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Senior Big Data Developer

    2 months ago

    Bengaluru, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Senior Big Data Developer

    2 months ago

    Bengaluru, India IntraEdge Full time

    We are looking for a highly skilled Senior Big Data Developer to join our engineering team. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems. You will work closely with cross-functional teams to architect scalable data pipelines and provide valuable insights through advanced data...

  • Big Data Developer

    5 days ago

    Bengaluru, India Luxoft Full time

    Project Description:As a Senior Engineer in the Data Engineering & Analytics team, you will develop data & analytics solutions that sit atop vast datasets gathered by retail stores, restaurants, banks, and other consumer-focused companies. The challenge will be to create high-performance algorithms, cutting-edge analytical techniques including machine...

  • Big Data Developer

    3 months ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!TCS is hiring for Big Data DeveloperDesired Experience: 5+ YearsJob Location: Chennai/ Bangalore / Pune / MumbaiRequire skillset: Big Data, Hadoop, Spark, Scala, HiveJob Description:-Must Have Technical Qualifications:SparkHadoopHiveScalaNice to Have Qualifications: Data Engineer CertificationExperience with Apache Beam.Technical...