Insights
Data migration to Hadoop delivers 80% cost savings while improving performance for bank
THE CHALLENGE
To reduce costs, our financial customer needed to migrate all their business and banking data from Teradata to Hadoop. But the data to be migrated was extremely sensitive and essential for daily business activities, which meant the migration needed to be highly secure with no downtime. To add to the complexity, the data came from multiple banking sectors such as financial data, loans, credit cards, and consumer banking, each with its unique migration challenges. Our customer needed a technology partner that could handle these challenges and complete the data migration in just 18 months.
THE SOLUTION
Beyondsoft was chosen to plan and implement the migration from Teradata to Hadoop. Initially, our customer had estimated the scope of the migration to be 2,000 tables with 2,800 objects. However, once Beyondsoft initiated the work, we found they had inadvertently miscalculated and that there were actually 6,000 objects, making the 18-month project timeline even more challenging.
Additionally, because the migration source and destination were very different, to avoid data and functionality issues, Beyondsoft needed to redefine the data architecture. By redesigning the architecture to accommodate the destination format, Beyondsoft achieved performance improvements and complied with end-user requirements.
Furthermore, to avoid disrupting any services that were dependent upon the data, Beyondsoft worked with the customer to create a prioritization plan for the migration, starting with the most frequently used data first and ending with infrequently used data. Throughout the project, Beyondsoft ensured that more than 100 user entities who required data did not see any downtime, even when occasional issues were encountered.
The redesigned Hadoop architecture
THE RESULTS
The data migration was a resounding success, delivering the following benefits to our customer:
- Migration from Teradata to Hadoop with no downtime.
- On-time project completion.
- Reduced data costs by 80%.
- Achieved a 30% performance improvement.
TECHNOLOGIES USED
Beyondsoft used the following technologies:
- Presto as a query engine
- Alluxio for data orchestration
- Apache Hive for managing tasks and collaboration
- Yarn as a package manager
- Jenkins as an automation server
- Apache Superset for data exploration and data visualization
- Apache Spark for data processing
Why BEYONDSOFT
私たちのオンショア、ニアショア、オフショアのデリバリーサービスは、24時間365日、お客様のビジネスをサポートします。日本の大手SI企業に対し数十年にわたりサービスを提供しています。1999年以来、日本で25年の経験を持っています。日本には500-600人のスタッフがいます。長年にわたる成功事例は、私たちがお客様の投資対効果においてどれほど重要であるかを証明しています。シンガポールは私たちのグローバル本部であり、世界各地に14の地域オフィスを持っています。
30年以上にわたる強力なITコンサルティングサービスの経験
COBOL, C, Java, Pythonなど幅広い開発言語や開発環境に対応
SAPにおけるABAP, BTP, Fioriなど幅広く対応
40以上のグローバルデリバリーネットワークを持つ4大陸をカバー
CMMI 5、ISO 9001、ISO 14001、ISO 20000、ISO 27001、ISO 22301、ISO 45001、TMMi5の認証
マイクロソフトの専門家であるAzure MSP
Beyondsoftと共にビジネスの潜在力を最大限に引き出しましょう。私たちがどのようにイノベーションを推進し、効率を向上させ、ビジネスの成長を実現するのか、ぜひご相談ください。