IBM Software Group

Configuring WebSphere Adapter for File Transfer Protocol Adapter using WebSphere Transformation Extender
Alex Reyes (reyesa@us.ibm.com) WebSphere Adapter L2 Support Ken Amelio (kamelio@us.ibm.com) WebSphere Adapter L2 Support Greg McEachern (greg.mceachern@us.ibm.com) WTX L2 Support 25 August 2011

WebSphere Support Technical Exchange

IBM Software Group

Agenda
Presenter background Audience benefits WebSphere Adapter for FTP Overview Inbound WebSphere Transformation Extender Overview Using WebSphere FTP Adapter with WTX WebSphere FTP Adapter Wizard Launcher Source Event for WS FTP Adapter Inbound Debugging using WebSphere FTP Adapter trace file Demonstration Summary Resources Questions and answers

WebSphere Support Technical Exchange

2 of 29

IBM Software Group

Presenters background
Alex Reyes
ESS and AIX system admin SME for WebSphere Adapters for FTP, Flat File, PeopleSoft, and JText Ken Amelio WebSphere Adapters support since 2005 SME for WebSphere Adapters for FTP, Flat File, JDE, and SAP Greg McEachern WebSphere Transformation Extender (WTX) Support since 1999 (formerly Mercator / DataStage TX) WTX Support Team Lead since 2006
WebSphere Support Technical Exchange 3 of 29

IBM Software Group

Audience Benefits
Learning how to configure WebSphere FTP Adapter using WebSphere Transformation Extender

WebSphere Support Technical Exchange

4 of 29

IBM Software Group

WebSphere Adapter for FTP - Overview

FTP Adapter functions
Adapter creates integrated processes to manage files without knowing protocol details Brokers: WPS, WESB External: FTP server Adapter acts as a service provider in an SOA architecture To send or retrieve data Part of a module - WPS or WESB

WebSphere Support Technical Exchange

5 of 29

IBM Software Group

WebSphere Adapter for FTP - Overview

FTP Adapter functions (continued)
Adapter creates interfaces to: Hide details of how operations are obtained Interact with Adapter instead of FTP server Manage userIDs/passwords Manage operations

Adapter implements reusable unit design Inbound or outbound Standard business interface

WebSphere Support Technical Exchange

6 of 29

IBM Software Group

WebSphere Adapter for FTP - Overview

Module components
Imports and exports Project Unit of deployment

FTP Adapter processing types

Outbound Inbound

WebSphere Support Technical Exchange

7 of 29

IBM Software Group

WebSphere Adapter for FTP Inbound

The Adapter polls a file system associated with an FTP server for events at specific intervals. Each time a file is created in the event directory, the adapter tracks the file as an event and it converts it to a business object

WebSphere Support Technical Exchange

8 of 29

IBM Software Group

WebSphere Adapter for FTP Inbound

Supported operations EmitFTPFile (default) End point where Adapter sends BOs after events triggered by enterprise information server An external application can further process BOs. EmitFTPFile() method on Java component can be customized for specific business requirements

WebSphere Support Technical Exchange

9 of 29

IBM Software Group

WebSphere Transformation Extender - Overview

WebSphere Transformation Extender (WTX) is a Universal Data Transformation and Validation Engine used to process complex data without manual coding Basics of WTX are the following concepts:
Validation Type Trees or XML Schemas Transformation Maps and Mapping Rules Routing Inputs and Outputs using Adapters or Streams

WebSphere Support Technical Exchange

10 of 29

IBM Software Group

WebSphere Transformation Extender - Design

WTX Design Tools
Design Studio
Eclipse based & a perspective in Message Broker Toolkit or WebSphere Integration Developer (WID) Design, Import and Edit Type Trees Design & Test Maps and Mapping Rules

Database Interface Designer

Create queries, Import Type Trees from DB objects

Integration Flow Designer

Create Launcher systems of watches

Resource Registry
Create & Configure aliases and values
WebSphere Support Technical Exchange 11 of 29

IBM Software Group

WebSphere Transformation Extender - Runtime

WTX Runtime editions WTX with Command Server
Batch method to run maps

WTX with Launcher

Event driven method to run maps

WTX for Integration Servers

Plug-in for Message Broker, Process Server, or WebSphere Enterprise Service Bus (WESB)

WTX for Application Programming

WTX API can be used to run maps from other applications such as C/C++ and Java
WebSphere Support Technical Exchange 12 of 29

IBM Software Group

WebSphere Transformation Extender - Map

A Map defines the WTX Transformation
Map Sources and Targets Defined as Input and Output Cards Use either Type Trees or XML Schemas as data definitions Use Adapters or Streams to Receive and Send data Sources Validate and Identify the input data objects Targets Define how the data is Transformed Input to Output, Output to later Output Using Simple to Complex Mapping Rules which can include a wide range of Mapping Functions
WebSphere Support Technical Exchange 13 of 29

IBM Software Group

Using WebSphere FTP Adapter with WTX

WebSphere (WS) FTP Adapter used in WTX Map input or output cards WTX Design Studio includes WS FTP Adapter Wizard WS FTP Adapter Wizard used to define the Command Configuration
Processing Direction (Inbound or Outbound) Connection Properties Operations Generate Command Configuration Parameters
WebSphere Support Technical Exchange 14 of 29

IBM Software Group

Design Studio & WS FTP Adapter Wizard

XML Schemas Type Trees System Definition System WSDL Map Source

Use box to select Service Definition file or WS FTP Adapter Wizard

WebSphere Support Technical Exchange 15 of 29

IBM Software Group

WS FTP Adapter Wizard

Select Processing Direction and Define Connection Properties

WebSphere Support Technical Exchange

16 of 29

IBM Software Group

WS FTP Adapter Wizard (continued)

Define the Operations then select the Finish button to Generate Command Configuration Parameters

WebSphere Support Technical Exchange

17 of 29

IBM Software Group

WS FTP Adapter parameter / property types

There are different WS FTP Adapter parameter / property types that are used for either WS FTP Adapter inbound or outbound processing. Inbound and outbound WS FTP Adapter Parameters:
General properties = -wtx:

Inbound WS FTP Adapter Parameters:

Activation specification properties = -as:

Outbound WS FTP Adapter Parameters:

Managed (J2C) connection factory properties = -mcf: Interaction specification properties = -is:

WebSphere Support Technical Exchange

18 of 29

IBM Software Group

Example WS FTP Adapter parameters

Inbound WS FTP Adapter Parameters:

Outbound WS FTP Adapter Parameters:

WebSphere Support Technical Exchange

19 of 29

IBM Software Group

WebSphere FTP Adapter Inbound with WTX

WS FTP Adapter Inbound processing with WTX requires using the WTX Launcher with a Source Event WTX Launcher is an event-driven software model for linking & executing maps Runs as a multi-threaded service on Windows. Runs as a multi-threaded daemon on Unix, Linux, USS Watch defined as either Source Event (listener / triggers) or Time Event (scheduled in secs, mins, hours or days)

WebSphere Support Technical Exchange

20 of 29

IBM Software Group

Integration Flow Designer defines SourceEvent

The SourceEvent is set to ON in the Watch Launcher Settings System file .msl is generated and deployed to the Launcher

WebSphere Support Technical Exchange

21 of 29

IBM Software Group

WTX Example for WS FTP Inbound

1. Open the FTPIn.msd file in the Integration Flow Designer. 2. Change the appropriate file path names, using the More Find/Replace option. 3. Change the FTP adapter parameters on the input card for the adapter commands specific to your FTP server. 4. Build and analyze the system. 5. Generate the "FTPIn.msl" file. 6. Copy the "FTPIn.msl" file to <WTX install>\systems\ directory. 7. Start the Launcher as a service. 8. Start the Management Console. 9. Create or copy a file on ftp server in directory defined in FTP adapter command line with a command option "-as:eventDirectory. 10.Monitor the maps being run through the Management Console. 11.Check the output files.
WebSphere Support Technical Exchange 22 of 29

IBM Software Group

Debugging using WS FTP Adapter Trace

WS FTP Adapter trace enabled using the T (trace) or TV (trace verbose) parameter
<6700-1612-08/03/11 19:15:30>: 19.15.30.968 - 08/03/2011 IBM WebSphere Transformation Extender J2C Bridge, Version 8.3.0.4 <6700-1612-08/03/11 19:15:30>: 19.15.30.968 - 08/03/2011 Copyright 2011 IBM Corporation. All rights reserved. <6700-1612-08/03/11 19:15:30>: 19.15.30.984 - 08/03/2011 Built for JAVA on Fri 04/01/2011 at 22:27:14.89 <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 userName = anonymous <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 eventDirectory = /incoming <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 hostName = localhost <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 portNumber = 22 <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 eventFileMask = *.xml <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 localEventDirectory = C:\temp\Ftp_Inbound\ <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 sortEventFiles = no <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 password = ****** <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 protocol = FTP <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 retryInterval = 60001 <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 pollQuantity = 11 <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 pollPeriod = 2001 <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 localArchiveDirectory = C:\temp\Ftp_Archive <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 assuredOnceDelivery = true <6700-6924-08/03/11 19:15:31>: 19.15.31.125 - 08/03/2011 BONamespace = http://www.ibm.com/xmlns/prod/websphere/j2ca/ftp <6700-3808-08/03/11 19:15:41>: 19.15.41.796 - 08/03/2011 JCA Tracing: [ThreadID: 1 ][SequenceNumber: 434][ClassName: com.ibm.j2ca.ftp.FTPCommandAudit ] [MethodName: protocolCommandSent ][Logger: com.ibm.j2ca.FTPRAResourceAdapter ]ftp://localhost:22/incoming ## RETR /incoming/in.xml <6700-3808-08/03/11 19:15:41>: 19.15.41.812 - 08/03/2011 JCA Tracing: [ThreadID: 1 ][SequenceNumber: 435][ClassName: com.ibm.j2ca.ftp.FTPCommandAudit ] [MethodName: protocolReplyReceived ][Logger: com.ibm.j2ca.FTPRAResourceAdapter ]ftp://localhost:22/incoming ## 150 Opening BINARY mode data connection for /incoming/in.xml(5 bytes). <6700-3808-08/03/11 19:15:41>: 19.15.41.828 - 08/03/2011 JCA Tracing: [ThreadID: 1 ][SequenceNumber: 436][ClassName: com.ibm.j2ca.ftp.FTPCommandAudit ] [MethodName: protocolReplyReceived ][Logger: com.ibm.j2ca.FTPRAResourceAdapter ]ftp://localhost:22/incoming ## 226 Transfer complete. <6700-3808-08/03/11 19:15:41>: 19.15.41.843 - 08/03/2011 JCA Tracing: [ThreadID: 1 ][SequenceNumber: 446][ClassName: com.ibm.j2ca.ftp.FTPFileEventStore ] [MethodName: downloadFilesFromFTPServer ][Logger: com.ibm.j2ca.FTPRAResourceAdapter ]downloaded the event file to the LocalEventDirectory : C:\temp\Ftp_Inbound\in.xml

WebSphere Support Technical Exchange

23 of 29

IBM Software Group

WTX with WS FTP Demonstration

Demonstrate using the WebSphere FTP Adapter for Inbound processing as a Source Event watch within a WebSphere Transformation Extender Launcher system
FTP Server
Input Listener

Source Event Watch

WS FTP

Map

Output

File File System System

Launcher

WebSphere Support Technical Exchange

24 of 29

IBM Software Group

Summary
You learned about: FTP Adapter functionality WTX Functionality Configuration of WebSphere FTP server with WebSphere Transformation Extender Using WebSphere FTP Adapter Inbound with WTX Launcher Source Event Debugging using WebSphere FTP Adapter trace file
WebSphere Support Technical Exchange 25 of 29

IBM Software Group

Resources
WebSphere Adapters information center site
http://www-01.ibm.com/software/integration/wbiadapters/library/infocenter/

WebSphere Transformation Extender information center site

http://publib.boulder.ibm.com/infocenter/wtxdoc/v8r3m0/index.jsp

WTX info center for WebSphere FTP Adapter

http://publib.boulder.ibm.com/infocenter/wtxdoc/v8r3m0/index.jsp? topic=/com.ibm.websphere.dtx.wadapftp.doc/concepts/ac37160_.htm

WTX info center for WebSphere FTP Adapter Resources section that contains descriptions for the adapter properties
http://publib.boulder.ibm.com/infocenter/wtxdoc/v8r3m0/index.jsp? topic=/com.ibm.websphere.dtx.wadapftp.doc/references/srsha_reference.htm

WebSphere Support Technical Exchange

26 of 29

IBM Software Group

Connect with us!

1. Get notified on upcoming webcasts
Send an e-mail to wsehelp@us.ibm.com with subject line wste subscribe to get a list of mailing lists and to subscribe

2. Tell us what you want to learn

Send us suggestions for future topics or improvements about our webcasts to wsehelp@us.ibm.com

3. Be connected!
Connect with us on Facebook Connect with us on Twitter

WebSphere Support Technical Exchange

27 of 29

IBM Software Group

Additional WebSphere Product Resources

Learn about upcoming WebSphere Support Technical Exchange webcasts, and access previously recorded presentations at: http://www.ibm.com/software/websphere/support/supp_tech.html Discover the latest trends in WebSphere Technology and implementation, participate in technically-focused briefings, webcasts and podcasts at: http://www.ibm.com/developerworks/websphere/community/ Join the Global WebSphere Community: http://www.websphereusergroup.org Access key product show-me demos and tutorials by visiting IBM Education Assistant: http://www.ibm.com/software/info/education/assistant View a webcast replay with step-by-step instructions for using the Service Request (SR) tool for submitting problems electronically: http://www.ibm.com/software/websphere/support/d2w.html Sign up to receive weekly technical My Notifications emails: http://www.ibm.com/software/support/einfo.html

WebSphere Support Technical Exchange

28 of 29

IBM Software Group

Questions and Answers

WebSphere Support Technical Exchange

29 of 29