INSTALLATION
Izy Sync is now broken up into small services, that can be put into the Izy Task Runner for continous syncing of data. Example data sources and services are: imap, gmail(gapi), slack, generic pop3, etc.
Notice that IMAP is still supported by the izy-sync package.
Commandline Usage
IMAP Server Sync
Many services support the IMAP protocol. The IMAP protocol allows for querying via the 'SEARCH' command (see https://tools.ietf.org/html/rfc3501
page-49).
You may pass on the protocol specific data via the Izy command line configurations:
`
imap.search.key1 ALL imap.search.key2 SINCE imap.search.key3 SINCE 'June 24, 2016'
`
Below are a few common service provider specific examples.
Gmail
`
node cli.js method imap imap.user me@gmail.com imap.password mypass imap.host imap.gmail.com imap.port 993 imap.tls true mimestore.modhandler localfs mimestore.path /tmp/izyware/mimestore imap.search.key1 ALL imap.search.key2 SINCE imap.search.key3 '2010/01/01'
`
GoDaddy
NOTE: By default GoDaddy only supports POP3. Only unlimited Email plan supports IMAP.
`
node cli.js method imap imap.user me@email.com imap.password mypass imap.host imap.secureserver.net imap.port 993 imap.tls true mimestore.modhandler localfs mimestore.path /tmp/izyware/mimestore imap.search.key1 ALL imap.search.key2 SINCE imap.search.key3 '2010/01/01'
`
Gmail, API Based Mailbox Access
You may also access items through the Google gmail apis. You would need to run a the worker task for gmail on your machine first:
`
cd thirdparty/gmail
node taskrunner.js
`
Note that the taskrunner may be configured to use a socket server. For example to enable izysocksserver1
you can use SSH:
`
ssh -D 19999 user@host.com
`
Notes about session tokens and API limitations
Grabbing the Session Data
- go to https://developers.google.com/apis-explorer/
search/messages/m/gmail/v1/gmail.users.messages.list?userId=me&_h=1&
Click authorize and execute*
- Check only [x] https://mail.google.com/
- Make sure developer console is open and you are tracking the network traffic
Click authorize and execute* (again)
- Cut & Parse the entire heads tab for https://content.googleapis.com/gmail/v1/users/me/messages?key=...
- Make sure each section's name (Request Headers, is present in the payload)
GAPI behavior
- The first time, it will ask you to pick an account and it will confirm that you want to allow GOOGLE API EXPLORER to Read, send, delete, and manage your email.
- A confirmation email is sent
Google APIs Explorer connected to your Google Account
- Another confirmation email another security email was sent to the backup email account.
- The emails above were NOT sent for an MFA account but it they were sent for a non MFA (This is as of June 26 2017).
- Works with logged-in and MFA enabled (no further MFA verification)
- The data download is not throttled by size.
- The session cookie expires after about an hour or so (not predictable)
- The download rate is about 400MB/hour
Query Mime Repository Database
If you are dealing with a file based repository, you can get the oldest date by:
`
find . -type f -exec grep -i 'To: email' {} \;
`
remove -r from ls to get the newst date
NOTE
for more details, visit https://izyware.com
ChangeLog
V6.1
- 6100044: implement HAR (HTTP Archive) data parser
* Supports generation ['net.httprequest'] compatible chain items for replaying the HAR contents..
* HAR is defined in the W3C Specification is an archival format for HTTP transactions that can be used by a web browser to export detailed performance data about web pages it loads.
- 6100043: update .gitignore