BI/Reporting Engineer
3 days ago
What we're looking for:
• Overall 10 years of experience in Industry including 6+Years of experience as developer using Databricks/Spark Ecosystems.
• Hands on experience on Unified Data Analytics with Databricks, Databricks Workspace User Interface, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL.
• Good understanding of Spark Architecture with Databricks, Structured Streaming. Setting Microsoft Azure with Databricks, Databricks Workspace for Business Analytics, Manage Clusters In Databricks, Managing the Machine Learning Lifecycle
• Hands on experience Data extraction(extract, Schemas, corrupt record handling and parallelized code), transformations and loads (user - defined functions, join optimizations) and Production (optimize and automate Extract, Transform and Load)
TECHNICAL SKILLS
- Spark Data Frame API
- Python for Data Science
- Spark Programming
- SQL for Data Analysis
- Simplify Data analysis With Python
- Manage Clusters Databricks
- Databrick Administration
- Data Extraction and Transformation and Load
- Implementing Partitioning and Programming with MapReduce
- Setting up Azure Databricks Account
- Linux Command
What you'll be doing:
- Experience in developing Spark applications using Spark-SQL in Databricks for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into the customer usage patterns.
- Extract Transform and Load data from sources Systems to Azure Data Storage services using a combination of Azure Data factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data ingestion to one or more Azure services (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in Azure Databricks
- Develop Spark applications using pyspark and spark SQL for data extraction, transformation, and aggregation from multiple file formats for analyzing and transforming the data uncover insight into the customer usage patterns
- Hands on experience on developing SQL Scripts for automation
- Responsible for estimating the cluster size, monitoring, and troubleshooting of the Spark databricks cluster
- Ability to apply the spark DataFrame API to complete Data manipulation within spark session
- Good understanding of Spark Architecture including spark core, spark SQL, DataFrame, Spark streaming, Driver Node, Worker Node, Stages, Executors and Tasks, Deployment modes, the Execution hierarchy, fault tolerance, and collection
- Collaborate with delivery leadership to deliver projects on time adhering to the quality standards
- Contribute to the growth of the Microsoft Azure practice by helping with solutioning for prospects
- Problem-solving skills along with good interpersonal & communication skills
- Self-starter who can pick up any other relevant Azure Services in the Analytics space
-
Power BI Reporting Engineer
2 weeks ago
IN-KA-Bangalore, India (SKAV Seethalakshmi) GESC Arrow Electronics Full time ₹ 5,00,000 - ₹ 15,00,000 per yearPosition:Power BI Reporting Engineer (Techno-functional)Job Description:What You will Be Doing Position Overview:The BI Engineer will be responsible for developing, implementing, and optimizing BI reports, dashboards, and data models to support Arrow's business insights and analytics needs. The ideal candidate will have a solid understanding of business...
-
Infrastructure Engineer II
14 hours ago
IN-KA-Bangalore, India (SKAV Seethalakshmi) GESC Arrow Full time US$ 60,000 - US$ 1,20,000 per yearPosition:Infrastructure Engineer IIJob Description:What you will be doing:Be a Part of the technical team in cloud engineering platform techniques and processes such as: Infrastructure as Code and continued automation of tasks Develop and grow Kubernetes based microservices clusters in a Cloud OrganizationProvide direction on engineering platform in...
-
Applications Engineer
3 days ago
IN-KA-Bangalore, India (SKAV Seethalakshmi) GESC Arrow Full time US$ 60,000 - US$ 1,20,000 per yearPosition:Applications EngineerJob Description:Principal Accountabilities● Designs and develops software solutions to meet business requirements. Manages full software development lifecycle including testing, implementation, and auditing. Performs product design, bug verification, and beta support, which may require research and analysis. Operates under...
-
Bi/ Reporting Engineer Ii
4 weeks ago
Bangalore, Karnataka, India Arrow Electronics Full timePosition BI Reporting Engineer II What You will Be Doing Position Overview The BI Engineer will be responsible for developing implementing and optimizing BI reports dashboards and data models to support Arrow s business insights and analytics needs The ideal candidate will have a solid understanding of business intelligence data analysis and visualization...
-
Applications Engineer II
14 hours ago
IN-KA-Bangalore, India (SKAV Seethalakshmi) GESC Arrow Full time ₹ 20,00,000 - ₹ 25,00,000 per yearPosition:Applications Engineer IIJob Description:What you will be doing:EBS R12 implementation experience with Techno Functional skills sets.Strong on the following modules General Ledger, Account Receivables, Account Payables, Purchasing, Inventory, Order Management, EBS TaxLead complex development activities by providing architect level technical services...
-
Data Analyst – Power BI
2 weeks ago
Bangalore, KA, IN, Gainwell Technologies Full time ₹ 9,00,000 - ₹ 12,00,000 per yearPower BI Analyst Summary Data Analyst – Power BI Date Location: Remote Employment Type: Full-Time Job Summary: We are seeking a skilled and detail-oriented Data Analyst with strong experience in Power BI and Python to join our team. The ideal candidate will have a solid understanding of reporting principles, data visualization, and...
-
BI Reporting Engineer
4 weeks ago
Noida, India Barclays Full timeJob Description Join us as a BI Reporting Engineer at Barclays where you will spearhead the evolution of our infrastructure and deployment pipelines, driving innovation and operational excellence. You will harness cutting-edge technology to build and manage robust, scalable and secure infrastructure, ensuring seamless delivery of our digital solutions. To be...
-
Cognos BI Reports Developer
3 days ago
India ProArch Full time ₹ 12,00,000 - ₹ 36,00,000 per yearProArch is excited to announce an opening for a Cognos BI Report Developer to join our dynamic team. In this role, you will be responsible for designing, developing, and delivering reports and dashboards using Cognos BI tools. You will work closely with stakeholders to understand their reporting requirements and create insightful visualizations that aid in...
-
BI Engineer
3 weeks ago
bangalore, India Sky Systems, Inc. (SkySys) Full timeRole: BI Engineer Position Type: Full-Time Contract (40hrs/week) Contract Duration: Long Term Work Schedule : 8 hours/day (Mon-Fri) Location : Hybrid - 4x days onsite in Pune, India Overview: We are seeking a skilled BI Engineer with strong experience in MicroStrategy, Power BI, and SQL to design and deliver data-driven reporting, dashboards, and analytics...
-
PL/SQL + ETL + BI Reporting
1 week ago
Hyderabad, India Tata Consultancy Services Full timeJob Description Role - PL/SQL + ETL + BI reporting Location - Hyderabad Experience range - 8 - 12 years Must have skills : - 8-12 years of strong PLSQL development experience in data engineering or data analytics platforms - Write complex SQL queries and stored procedures to extract and analyze data for reporting purposes. - Develop, maintain, and optimize...