Big Data Engineer

1 week ago

Bengaluru, India ANB IT Solutions Pvt Ltd Full time

Job Description :


- Minimum of 7+ years of progressive experience in Data Engineering, with a proven track record in pipeline creation and implementation.

- Strong awareness and hands-on experience with various data tools and platforms, including Hive, Hadoop, Starburst, and other Big Data technologies.

- Proficiency in programming languages such as SQL, Python, Spark, and Java.

- Good working knowledge and practical experience with ETL processes utilizing Java Spark, Python Spark, or Spring Batch.

- Advanced SQL skills and extensive experience with relational databases and database design principles.

- Strong proficiency in object-oriented programming languages, specifically Python, PySpark and Java, Java Spark (a must-have).

- Demonstrable experience working with data Lakehouse architectures, such as Iceberg/Starburst.

- Strong proficiency in scripting languages like Bash for automation and system administration tasks.

- Strong proficiency in designing, implementing, and managing data pipeline and workflow management tools (e.g., Apache Airflow, Luigi, etc.).

- Knowledge of cloud platforms such as Databricks, AWS (Amazon Web Services), or GCP (Google Cloud Platform) is a significant plus.


(ref:hirist.tech)

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Etaclam Techno Services Full time ₹ 12,00,000 - ₹ 14,40,000 per year

    Job Title: Big Data EngineerLocation: BengaluruExperience Required: 5 to 8 yearsJob Description:We are looking for a skilled Big Data Engineer with strong hands-on experience in PySpark and SQL. This is a hybrid role, requiring the candidate to work both remotely and from the office as needed. The ideal candidate should be comfortable working on large-scale...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Coders Brain Full time

    Job Description Roles and Responsibilities: - Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation. - Work closely across an array of various teams and organizations in the company (including partners, customers) Basic Qualifications: - Bachelor's...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Reveille Technologies,Inc Full time

    We're Hiring: Big Data Engineer – Full-Time Looking for a skilledBig Data Engineerto join our team inBangaloreRole: Big Data Engineer Grade: G4 |TSR Location: Bangalore (Onsite/Hybrid – specify if needed) Budget: ₹13,39,200 Experience: 4–6 years Skills: Azure Databricks (ADB) PySpark SQL Spark (Scala/Python) Terraform Airflow & Kubernetes Data...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...

  • Big Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India IT Firm Full time

    Role Overview :As a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions.Mandatory Skill...

  • Big Data Engineer

    1 week ago

    Bengaluru, India The IT Firm Full time

    Role OverviewAs a Big Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that support data analytics, reporting, and real-time processing. You will collaborate with data scientists, business analysts, and software engineers to design robust solutions that drive data-driven decisions. Mandatory Skill...

  • Big Data Engineer

    3 days ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...

  • Big Basket

    1 week ago

    Bengaluru, India Big Basket Full time

    What would you be doing/ Expected from this role? - Be responsible for Platforms Team roadmap and engineering execution from conceptualization to delivery of current and next-generation tools & technologies.- Manage release planning, execution, deployment of all tools maintained by Platforms Team, for running production and non-production environments...

  • Big Data Engineer

    5 days ago

    Bengaluru, Karnataka, India RiskInsight Consulting Pvt Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databases. Build and maintain scalable data pipelines for effective data ingestion, transformation, and analysis. Collaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate...

  • Big Basket

    3 weeks ago

    Bengaluru, Karnataka, India big basket Full time

    As a Software Engineer we are looking for developers who share our passion for building world class software. If you are excited about the prospect of changing the way India shops for groceries and being a pioneer then this a great home for you. Not to mention the thrill of building products that millions use daily and using cutting edge technology to make...