Data Engineer-Data Platforms
IBM
Date: 3 weeks ago
City: Pune, Maharashtra
Contract type: Full time
Introduction
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role And Responsibilities
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
Master's Degree
Required Technical And Professional Expertise
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
Your Role And Responsibilities
As a Data Engineer at IBM, you'll play a vital role in the development, design of application, provide regular support/guidance to project teams on complex coding, issue resolution and execution.
- Your primary responsibilities include:
- Lead the design and construction of new solutions using the latest technologies, always looking to add business value and meet user requirements.
- Strive for continuous improvements by testing the build solution and working under an agile framework.
- Discover and implement the latest technologies trends to maximize and build creative solutions
Master's Degree
Required Technical And Professional Expertise
- Experience with Apache Spark (PySpark): In-depth knowledge of Spark’s architecture, core APIs, and PySpark for distributed data processing.
- Big Data Technologies: Familiarity with Hadoop, HDFS, Kafka, and other big data tools. Data Engineering Skills: Strong understanding of ETL pipelines, data modeling, and data warehousing concepts.
- Strong proficiency in Python: Expertise in Python programming with a focus on data processing and manipulation. Data Processing Frameworks: Knowledge of data processing libraries such as Pandas, NumPy.
- SQL Proficiency: Experience writing optimized SQL queries for large-scale data analysis and transformation.
- Cloud Platforms: Experience working with cloud platforms like AWS, Azure, or GCP, including using cloud storage systems
- Define, drive, and implement an architecture strategy and standards for end-to-end monitoring.
- Partner with the rest of the technology teams including application development, enterprise architecture, testing services, network engineering,
- Good to have detection and prevention tools for Company products and Platform and customer-facing
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Senior Research Analyst - Loan Investigation
Crisil,
Pune, Maharashtra
3 days ago
Hiring for immediate joiners: investigations Work with team of onshore analysts in NY shiftDaily Operation of the Investigation SectionReceive inquires via phone, SWIFT, etc. related to funds transfersLog case onto the lntelliTracs systemResearch the payment via lntelliTracs, MTS, FLEXCUBE, etc. Work on resolution of inquiries in a timely mannerAssign cases to investigators, ensure that case has proper documentation attachedApprove replies....
Account Manager_Pune
Noventiq India,
Pune, Maharashtra
4 days ago
Noventiq (Noventiq Holdings PLC) is a leading global solutions and services provider in digital transformation and cybersecurity, headquartered in London. The company enables, facilitates, and accelerates digital transformation for its customers’ businesses, connecting 80,000+ organizations across all sectors with a vast selection of best-in-class IT vendors, alongside its own services and solutions.Noventiq delivered record gross revenue of $1.6 billion for...
Proposal Coordinator
Bell Immersive Technology Solutions,
Pune, Maharashtra
4 days ago
Our growing company is in need of a resourceful Proposal Coordinator to work with business development team personnel and oversee proposal development, ensuring they keep with company standards.Duties And ResponsibilitiesThe Proposal Coordinator will collaborate with various Proposal Managers for writing, formatting, and producing responses to Requests for Proposals (RFP), Requests for Information (RFI), Sources Sought, and other marketing materials. This...
