Job Description

Skill: Data Engineering

• Experience in Information Technology experience in Design, Development and Implementation of large scale and medium scale Data warehousing Applications using ETL tool IBM Infosphere Information server DataStage, SQL and Unix.
• Experience in Snowflake Implementation.
• End to End experience in all stages of Software Development Life Cycle including Data mapping, build, unit testing, system integration testing and performance tuning.
• Experience with SQL implementation.
• Experience with orchestration tool like Control M, TWS scheduler.
• 5-7 years With a broad portfolio of AWS infrastructure tools (EBS, S3, EC2, Elastic IP, Route 53, VPC) and with cloud infrastructure management and automation technologies.
• Working with basic structured, semi-structured, and unstructured data.
• Exposure to modern data/analytics architecture (Big Data, Cloud, etc.).
• Exposure to advanced analytics tools (Python, R, etc). Scripting (shell, python, ruby) skills for monitoring and automation.
• Strong understanding of the principles of Data Warehousing using fact tables, dimension tables and star/snowflake schema modelling.
• Worked extensively with Dimensional modelling, Data migration, Data cleansing, ETL Processes for data warehouses.
• Developing and maintaining data pipelines for efficient data extraction, transformation, and loading (ETL) processes.
• Collaborating with data analysts, data architects, and software engineers to understand data requirements and deliver relevant data sets (e.g., for business intelligence).
• Building required infrastructure for optimal extraction, transformation and loading of data from various data sources using AWS and SQL technologies.
• Advanced knowledge and expertise in designing and developing ETL jobs using IBM Infosphere DataStage and sound experience in other IIS suite like Information Analyzer and basics on Quality Stage.
• Experience in IBM IIS DataStage Migration projects from planning to execution.
• Possess very strong expertise & knowledge in core banking and insurance domain applications. Solutions oriented professional with excellent skills in field of analysis, design, development, customizations, and implementation of software applications.
• Performance Tuning and Optimization of ETL jobs and SQL queries in ad-hoc and complex report environments.
• Extensive experience with ETL to load data from Flat Files, XML, Oracle and DB2 to ODBC databases & to perform various transformations using Filter, Transformer, Join, Lookup, Aggregator, Change Capture, Remove Duplicate, Shared container, Nested condition, Routines, Command activity stages to create robust mappings in the DataStage Designer.
• Familiar in using highly scalable parallel processing infrastructure using parallel jobs and multiple node configuration files.
• Experienced in scheduling Sequence and parallel jobs using DataStage Director, UNIX scripts and scheduling tools.
• Experience in troubleshooting of jobs and addressing production issues like data issues, ENV issues, performance tuning and enhancements.
• Extensive experience in design and development of Decision Support Systems (DSS).
• Extensive experience in Unit Testing, Functional Testing, System Testing, Integration Testing, Regression Testing, User Acceptance Testing (UAT) and Performance Testing.
• Worked with various databases like Oracle 10g/9i/8i, DB2, SQL Server, Teradata.
• Experience in writing PL/SQL stored procedures, functions, and packages.
• Proficient in writing Uni x shell scripts and extensive experience working with Unix operating systems.
• Provided value addition to that client by developing new solutions of process, which reduced manual intervention of users and gained significant performance improvement of existing process.