Cloud Integration
Stages, Options, Timeline, and Costs
ScienceSoft has been providing cloud application development and integration services since 2012.
Cloud Integration: the Essence
The integration of cloud-hosted applications with other cloud or on-premise software of medium complexity usually takes around 8-12 months, including steps like planning and design, implementation and testing. The project requires a team of a project manager, a business analyst, an integration architect, developers, QA and DevOps engineers.
In software development since 1989, ScienceSoft helps build reliable, secure and convenient cloud-based integrations between custom and/or commercial systems.
Cloud App Integration Roadmap
The steps of the cloud application integration process and their timelines will differ depending on the number of applications integrated, their architecture, required legacy software modification, integration approach, complexity of security and compliance requirements, and more. Below are described the typical steps we at ScienceSoft take to perform cloud application integration.
Step 1. Planning and design
Duration: 3-5 weeks
Integration scoping and planning
At this stage, ScienceSoft's team:
1
Defines the systems/processes to be integrated and data to be shared.
2
Elicits existing concerns from the business side (security, compliance, business process disruption during integration activities, availability of resources to operate and manage the integrated system).
3
Defines infrastructure capabilities and constraints.
4
(when legacy systems are involved) Audits legacy software to be integrated, analyzing its capabilities and constraints.
5
Figures out how the data should flow and whether the data needs to be transformed into a different format.
6
Checks how many communication protocols between integrated applications will be used.
7
(optional, mostly for strategic integration initiatives) Examines existing/defines new types of standards that will be used in the integration architecture (e.g., for application interfaces, message formats, process models, an enterprise metadata model).
8
Defines non-functional requirements for the integrated system (performance, availability, security, etc.).
9
Defines compliance requirements.
10
Checks if there are any ready integration solutions or integration interfaces available.
|
Best practice: We also often define business metrics to help our clients measure and understand the integration initiative success (e.g., improved order processing/delivery time, reduced transaction errors, reduced time to introduce a new software solution, etc.). |
Integration approach selection
ScienceSoft's team decides on an appropriate cloud app integration approach from 4 major types described below. The choice between direct and mediated integration approaches will depend on the number of application to be integrated, planned short-term and long-term investments, overall IT strategy (for enterprises)/business strategy, non-functional requirements to the integrated system (performance, availability, security), the necessity to integrate with legacy software, and more.
Direct (point-to-point) integration
- Using tools and/or out-of-the-box integration provided by applications’ vendors.
- Using custom code.
Mediated integration
- Using Enterprise Service Bus (ESB). ESB is a central mediator (integration server) that takes over the responsibility for communication between services and undertakes message processing, transformation/modification, and routing, transaction management, process choreography, security management. Special adapters allow the applications to communicate with ESB translating or transforming the message data (e.g., XML to JSON, JMS to HTTP, XML to Java objects).
- Using an integration platform as a service (iPaaS). An iPaaS solution is a set of cloud services that often includes API management, orchestration, messaging and event management services.
It’s a rare case when a single integration pattern fits all the required connections when several apps are to be integrated. So, ScienceSoft often uses a combination of several integration approaches.
Optional: evaluation and comparison of tech stacks for the selected integration approach
ScienceSoft's BA and solution architect shortlist 2-3 preferable integration tech stacks (e.g, for an ESB-based integration – Talend ESB and SAP PI, for iPaaS-based integration – Azure iPaaS or Informatica iPaaS) and rate strengths and weaknesses of each option. Together with the project stakeholders, we decide on the most feasible option with the best strategic potential.
|
Best practice: When our clients also need their external partners to connect, we always keep in mind to discuss if their partners have or ready to employ the required infrastructure and skills to use the chosen integration technologies and support the planned communication standards. |
Step 2. Implementation and testing
Duration: 5-9 months to develop a new integration solution
The steps of this stage will differ depending on the chosen integration approach. Below, you can find exemplary scenarios for two most popular integration approaches.
Direct integration
- Designing and installing custom APIs or implementing ready-to-use APIs.
Mediated integration
- Building or buying a glue layer (message processor/ESB) that will handle message routing, modification, aggregation and changing the mapping of the data.
- Creating connections – select or build adapters for your applications to communicate with the glue layer.
- Orchestrating integration:
- Configuring triggers for requests sent to the service.
- Configuring invokes for requests sent from the service to the target.
The QA team works on:
- Verification of all uni- or bidirectional queries between the connected interfaces.
- Checking the completeness of distributed transactions.
- Approval of appropriate exceptions handling.
- Assuring the work of the failover and recovery mechanisms.
- Checking how well the integrated system works within established bandwidth limitations.
- Checking how good the system components are at fail-free processing of large data sets and handling an increased number of requests.
Step 3. Integrated system support and evolution
The support team monitors the integrated system performance and handles its scale-ups (the number of users) and scale-outs (the number of the integrated applications).
Cloud Integration by ScienceSoft
With 12 years of experience in cloud computing and hundreds of successful integration projects completed, ScienceSoft can help with:
Consulting
- Translating your needs into technical requirements.
- Integration architecture design.
- Security, performance, data quality requirements preparation.
- Guide to compliance with the required security standards and regulations (HIPAA, HITECH, SOC 2, SOC 3, and more).
- A detailed cloud app integration project roadmap.
Implementation
Our team takes over:
- Integration needs analysis, application and infrastructure analysis.
- Integration architecture design.
- Migration, re-engineering, re-architecting of the to-be-integrated applications (if required).
- Integration development, implementation and testing.
- After-launch support, user and admin training.
- Continuous management and evolution of the integrated ecosystem (on demand).
ScienceSoft as a Reliable Cloud Integration Partner
We wanted our product to integrate with various ticketing software to collect support tickets, analyze them with AI, and organize the elicited data into charts and visuals.
ScienceSoft’s team undertook the development of our product from scratch and showed deep expertise in the .Net environment and AWS and Azure services.
Bob Penland, Managing Partner, ServicePulse
Why ScienceSoft?
- In IT since 1989.
- 2 days – 2 weeks to start a new project.
- Integration and database architects with 7-20 years of experience.
- 12 years of experience in cloud development and migration.
- An official Microsoft and AWS Partner.
- 11 years in applying DevOps practices.
- 21 years in cybersecurity. All-level security configuration and monitoring (infrastructure, application logic, security testing, compliance).
- Expertise in 30+ industries.
- ISO 9001 certified quality management, ISO 27001 certified information security management, ISO 13486 certified quality management for medical devices and Software as a Medical Device, and more.
- Compliance with HIPAA, GAMP, PCI DSS, and more.
- ScienceSoft is a 3-Year Champion in The Americas’ Fastest-Growing Companies Rating by the Financial Times.
A Sample Team for a Cloud App Integration Project
Project Manager
- Plans the cloud app integration project, assigns tasks to the integration team and oversees tasks’ execution.
- Makes sure to provide stated project deliverables on time, on budget and of the required quality.
- Timely updates required stakeholders on the integration project progress.
- Communicates with cloud providers, SaaS vendors (in case of enterprise apps integration), and other vendors.
Business Analyst
- Gathers, clarifies and documents the integrated system requirements.
- Together with integration architect, defines the integration approach.
Integration Architect
- Designs the integration between cloud-hosted and other cloud/on-premises apps to meet the technical and business requirements.
- Develops an app architecture transformation and modernization roadmap (if necessary).
- Develops technical documentation relating to the integrated system architecture.
- Creates a strategy for disaster recovery and data integration.
- Designs frameworks and processes to support API development and management.
Developer
- Builds custom integration code (APIs, ESB, etc.). In case of pre-built integration, sets up triggers, chooses resulting actions from the other app and selects data to be sent.
DevOps Engineer
- Configures the integration infrastructure.
- Automates and streamlines development and release processes by introducing CI/CD pipelines.
- Monitors the integrated system performance, availability, security, etc.
QA Engineer
- Designs and implements a test strategy, a test plan and test cases for the integration solution, the to-be-integrated applications, and the target system on the whole.
- Assures that all availability, performance, security, and compliance requirements of the integrated solution are met.
- Checks the mechanisms of data validation and transformation, compensation events for failed or incomplete long-running transactions.
- Provides test summary reports.
Sourcing Models of Cloud App Integration
The entire cloud app integration process is in-house
- Direct supervision over the integration process and the team’s work.
- The integration project can be delayed or compromised due to the lack of the required resources or their insufficient experience.
- (for enterprises) The IT department may have to give up other priority projects to build the integration.
- All hiring and managerial efforts are on your side.
Partial or full outsourcing of technical resources
- Quick integration project start.
- Optimal human resource usage at peak times.
- Quick access to specific tech knowledge when required.
- Project team coordination, concerns about quick and quality integration solution delivery are partially or totally on your side.
Full integration process outsourcing
-
A vendor assumes full responsibility for the integration project, including:
- Team ramp-up and management.
- Integration solution design.
- Establishment and coordination of the integration process.
- Quality of the project results.
- High vendor risks.
Benefits of Application Integration with ScienceSoft
Data quality
ScienceSoft introduces data governance rules, error message management, message completeness verification, roll-back of distributed transactions to ensure consistent and comprehensive data across the integrated system.
Advanced integration security
We use sophisticated access control rules, industry-proven protocols for authentication and authorization, “safer” outbound connections, and more.
System performance management
We pay special attention to planning system capacity and middleware, design scalable architecture, introduce priority queues, effectively use timeouts and sync calls, logging and caching, conduct load and performance testing, network latency problem assessment.
Optimal integration journey
ScienceSoft starts with a feasibility study of its technical, economic and operational aspects of your integration initiative. Our consultants with 7-20 years of experience in the field investigate whether the project is worth your time and money and which integration scenario will bring max benefit.
Technologies We Recommend for Cloud Integration
At ScienceSoft, we often choose the following technologies for our cloud application integration projects:
Azure Integration Services
Best for: hybrid integration
Description
- Among leaders in 2020 Gartner Magic Quadrants for Enterprise iPaaS and Full Life Cycle API Management.
- Comprehensive set of integration capabilities covering applications and data with over 370 connectors.
- Serverless integration via Azure Functions.
- Services and tools support multi-cloud, on-premises and edge computing environments.
- Azure Integration Services is part of the larger Azure offering, giving you immediate, integrated access to any other cloud services you need, e.g., Azure Data Lake Storage for storing large volumes of unstructured data.
Pricing
AWS Integration Services
Best for: data integration
Description
- Comprehensive messaging suite comprising Amazon SNS (fully managed Pub/Sub messaging), Amazon SQS (fully managed message queues), Amazon MQ (managed message broker service for Apache ActiveMQ).
- AWS AppSync (to create flexible GraphQL APIs to securely access, manipulate, and combine data from one or more data sources) and API Gateway (to create, maintain, and secure REST APIs at any scale in serverless and web development).
- AWS Step Functions and AWS Lambda for serverless development.
Pricing
Informatica Intelligent Cloud Services
Best for: enterprise application integration
Description
- A leader in Gartner’s Magic Quadrant for Enterprise iPaaS for 7 years straight.
- Unified user experience across all data management services.
- The AI/ML-driven CLAIRE™ engine to accelerate and automate data governance processes.
- Cloud-native and scalable integration.
- Multi-cloud and serverless environments.
- The industry’s highest number of security certifications among cloud app integration solutions, including SOC 2, SOC 3, HIPAA, and HITECH.
Pricing
Starting at $2,000/month, free 30-day trial.
SAP Cloud Platform Integration
Best for: specialized enterprise application integration
Description
- Among leaders in 2020 Gartner Magic Quadrant for Enterprise iPaaS.
- SAP’s API Business Hub offers access to rich integration content packs with over 1,500 prebuilt, ready-to-run integrations, APIs and events that target specific business processes.
- Connects cloud applications with SAP and non-SAP cloud and on-premises applications.
Pricing
Cloud Integration Costs
The costs will vary depending on the specifics of the integration project. Major cloud application integration cost factors include:
- The number of applications to be integrated and the number of integration points.
- Cloud app integration approach (development of custom integration solution from scratch will require approximately ~4-6 FTE).
- Integration-readiness of the applications (both on the technical level and on the app logic level).
Types of costs related to cloud application integration
Integration solution infrastructure
Examples:
- Licensing for middleware (e.g., third-party ESB)
- Infrastructure for SOA implementation (service connector, service descriptor, asynchronous response handler, service interceptor, etc.).
- Additional computing to run new software
Skills development / acquisition
Examples:
Re-training of current resources / hiring of experts (either on the outsourcing or in-house basis) for:
- Building custom adapters/APIs or tailoring off-the-shelf adapters
- Designing and coding application modifications (if required)
- Implementing the integration solution: message broker/ESB/iPaaS (if required)
(for enterprises) Business costs
Examples:
- Establishment of cross-department teams for integration planning and evolution.
- Lost productivity and downtime associated with transitioning to new business processes, integration ramp-up, and business user training / knowledge transfer.
About ScienceSoft
A global IT consulting and IT services company headquartered in McKinney, TX, ScienceSoft provides end-to-end application integration services. Achieving project goals in spite of time and budget constraints, as well as changing requirements, is ScienceSoft's top priority. You set goals, we drive the project to fulfill them. We leverage our expertise to execute industry- and function-focused integrations and keep your integration journey quick and smooth. As the holder of ISO 9001 and ISO 27001 certifications, we rely on mature quality management and guarantee the cooperation doesn't pose any risks to the customers' data security.