weboob:dd07fce0391b2ec13ab6afec769eafd714596eb5 commitshttps://git.weboob.org/weboob/weboob/commits/dd07fce0391b2ec13ab6afec769eafd714596eb52018-12-02T12:39:30+01:00https://git.weboob.org/weboob/weboob/commit/dd07fce0391b2ec13ab6afec769eafd714596eb5[hsbc] Fetch Comptes de Tiers2018-12-02T12:39:30+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
Some HSBC connections have a link called "comptes de tiers" in which
users can check their family members accounts.
This patch enables the scraping of all third party accounts.
Closes: 7605@Zendeskhttps://git.weboob.org/weboob/weboob/commit/df3fa35a0de0cc17b437809aefbb99010d1acce2[sgpe] handle password expired2018-12-02T12:39:21+01:00Sylvie Yesye@budget-insight.comhttps://git.weboob.org/weboob/weboob/commit/60dfff3b27cb5cfd6ee6654f6928ceef9ec7f3b8[ameli] handle unavailable page2018-12-02T12:39:16+01:00Florian Duguetflorian.duguet@budget-insight.com
Closes: 14247@sibihttps://git.weboob.org/weboob/weboob/commit/8cae8ee20a53549acdf6b1ccd98d202f476fb737[ameli] handle error on login2018-12-02T12:35:59+01:00Florian Duguetflorian.duguet@budget-insight.com
Ameli display errors on login in different html tag, this fix handle a new one
Closes: 13911@sibi 29490@sibi 14644@sibi 13912@sibihttps://git.weboob.org/weboob/weboob/commit/93b1560ab4b7c0747a1bc1e79aec784415d88229[creditmutuel] handle website invalid label error message2018-12-02T12:35:50+01:00Sylvie Yesye@budget-insight.com
Closes: 16962@sibihttps://git.weboob.org/weboob/weboob/commit/e2ccd22199a63e0ec68bc1adda1585a428f5f83b[creditdunord] Implement Browser2 Market iter_investments2018-12-02T12:35:39+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The method was still in Browser 1 and was absolutely not flexible, many
accounts did not display any investments.
I also corrected the account typing, which works with the beginning and
the end of patterns instead of checking if "string" in "label".
Closes: 8315@zendeskhttps://git.weboob.org/weboob/weboob/commit/573984b798ef03d3acfcaef5a0e963f70031420d[weboob.tests] Added "if" condition on transaction amounts2018-12-02T12:35:27+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
There are errors raised in the backend when a transaction has an amount
if "0.00". However these transactions actually exist, so we should
check whether the amount is None and not if the balance is != 0.https://git.weboob.org/weboob/weboob/commit/ad6bf998be203e67457b782161612b9d31df1b21[bolden] Remodelled module with one main account and investments2018-12-02T12:35:14+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The money borrowed on Bolden should be considered as investments, no
individual accounts, with the available money retrieved as liquidities.
Only the borrowed money that is still ongoing should be considered, the
other investment lines without valuation are expired investments.
With this model, the sum of investment valuation + liquidities actually
fits the main account balance.
Closes: 7716@zendesk, 8244@zendeskhttps://git.weboob.org/weboob/weboob/commit/41892a1144bd94c70fbe4a8bddc499dd54cebda3[cragr] Skip recipients without label2018-12-02T12:35:05+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
Closes: 16623@sibihttps://git.weboob.org/weboob/weboob/commit/6661ec3bd01f8eff09ee208e286d95c9573cec2d[sgpe] some accounts are not able to do transfer2018-12-02T12:34:25+01:00Sylvie Yesye@budget-insight.com
there are no obvious reason so erase all assumptions
Closes: 18986@sibihttps://git.weboob.org/weboob/weboob/commit/1a29f2a9b3a14a42a3cefc7f637664016e97c4ec[axabanque] Handle error 500 page2018-12-02T12:34:04+01:00Maxime Pommiermaxime.pommier@budget-insight.com
Closes: 20146@sibi 8018@zendeskhttps://git.weboob.org/weboob/weboob/commit/190adbfb81dce29cba6717fb59201a8cbad82732[creditmutuel] Handle differed transfer2018-12-02T12:33:54+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
To do that, we have to add transfer object into the browser.py and
handle the exec_date.https://git.weboob.org/weboob/weboob/commit/9cb1daf4e5cf9d5ba5c95c216a5978f7f5733e3a[fortuneo] Add recipient: Handle validation when the first sms is expired2018-12-02T12:33:45+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
Here we inform the user to use the new sms code. It happens when user
waits more than 5 minutes to enter its code. We also catch error message
when the code validation is unsuccessful.
Closes: 7689@zendeskhttps://git.weboob.org/weboob/weboob/commit/1151a000d98d3b2fa21dfbeee4c22f913e81b484[caissedepargne] Added ActionNeeded when user have to fill investment form2018-12-02T12:33:34+01:00Maxime Pommiermaxime.pommier@budget-insight.comhttps://git.weboob.org/weboob/weboob/commit/6f4cd82d5b650b5521091e5749f42e41acfa36c4[weboob.browser.filters] Add colspan attribute to TableCell class2018-12-02T12:33:27+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The "colspan" attribute enables handling of &lt;td&gt; tags that have a
"colspan" attribute that is higher than 1. These columns occupy more
than one slot in the table, creating a column shift that we must handle
otherwise the col_names will not fit anymore with the col heads.https://git.weboob.org/weboob/weboob/commit/6e8710f7caed668aa37dc25c86103ac566b837f8[boursorama] update liquidities xpath2018-12-02T12:33:17+01:00Martin Sicotmartin.sicot@budget-insight.comhttps://git.weboob.org/weboob/weboob/commit/087c034739851df988f62b97e04748498c7e5a87[axabanque] Transfer: iban checking debug2018-12-02T12:33:10+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
On the website, the transfer validation page does not give the iban
information. Consequently, to avoid a crash when the old or new iban is empty we
force a skip of the account iban checking.https://git.weboob.org/weboob/weboob/commit/c342ea15db8a2b74ff23b2abc0f32724c77084f6[ing] We scrapped the "previsionnal balance" instead of coming2018-12-02T12:33:02+01:00Maxime Pommiermaxime.pommier@budget-insight.com
There are no way to get coming in ing, we scapped the wrong data
Closes: 7788@zendeskhttps://git.weboob.org/weboob/weboob/commit/7bfcdefaa45b116724627b53ebf090a8666d087f[creditmutuel] Change Account Type checking2018-12-02T12:32:53+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
In BMCE, a checking account has been found with a label like:
"XXXXXXX.XX Compte Cheques Particulier Mme XXXX".https://git.weboob.org/weboob/weboob/commit/6e4d0d46ab146694b83bdd7edb0144b1f0f51095[creditdunord] modified type market to fit "TITRES", "TIT." and "TIT"2018-12-02T12:32:46+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
Market accounts (compte titres) may have multiple ways of contraction so
I just put "TIT" that matched all of them.
Closes: 8315@zendeskhttps://git.weboob.org/weboob/weboob/commit/01f193c5a13356999bab436e2c70be19daba79e4[creditdunord] Re-indented whole CDNBasePage class2018-12-02T12:32:34+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
3 indentation spaces instead of 4https://git.weboob.org/weboob/weboob/commit/14c05557497507dfecb5630a84508a61e142e1ae[bnp] 'ibanCompteCrediteur' key in init transfer response is empty2018-12-02T12:32:24+01:00Sylvie Yesye@budget-insight.com
if it's empty, avoid check recipient_ibanhttps://git.weboob.org/weboob/weboob/commit/309ae667efa3c8f7192ef6b744c295fbb8a2d101[creditmutuel] Skip immediate debit cards2018-12-02T12:32:17+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
In the card space, we handle some immediate debit cards. For skipping them we
have to reach the good page to discriminate which is deferred or
immmediate card.https://git.weboob.org/weboob/weboob/commit/a1d5a221a9c31fbf6f0d0e243c60b3100d1f8f52[bnp] transfer fees are not always available2018-12-02T12:32:10+01:00Sylvie Yesye@budget-insight.com
set default value Decimal(0) for transfer feeshttps://git.weboob.org/weboob/weboob/commit/c1dd5472f240ff6149bb5cb28dd0dbbc8f52c662[boursorama] Included "assurance/comptes" in ignored accounts2018-12-02T12:32:02+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
In addition to "assurance/protection", the advertisement for
"assurance/comptes" also leads to an advertisement so I added this piece
of URL to the tuple of account URLs to ignore.
Closes: 28536@Sibihttps://git.weboob.org/weboob/weboob/commit/a7c3b591c93249409e8c1213424b04a7560638d2[cragr] Handle USD account2018-12-02T12:31:51+01:00Maxime Pommiermaxime.pommier@budget-insight.com
- The iter account path for items in td wasn't take care of one specific class for usd account
Closes: 8024@zendeskhttps://git.weboob.org/weboob/weboob/commit/eab25a36808651cd3fb94827f00fd2d4ca735f9d[creditmutuel] Fix card history navigation2018-12-02T12:31:34+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
For the second half of the history (the last 6 month), it seems now to
be mandatory to add 'secondHalf' value to reach the xml pages.
Closes: 1021612@redmine 28727@sibihttps://git.weboob.org/weboob/weboob/commit/ae7d78f4b1516fe9f9afed6943d12f52e64a51f4[ameli] add regex to login field2018-12-02T12:31:25+01:00Florian Duguetflorian.duguet@budget-insight.com
login is 'Numéro de sécurité social' and it has always 13 digits
but some users write 15 digits because of the key at the end,
which is present on 'Vitale' card, but not herehttps://git.weboob.org/weboob/weboob/commit/8da4dd88dd1089a91ce6c43ca75ddd3cb886cc6d[boursorama] Include personal insurances in ignored accounts2018-12-02T12:31:12+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
These insurances are not handled yet by the module and contain a URL
that is not handled by browser.py
Since they only are personal insurances, we just ignore them like car
insurances.
Closes: 28536@sibihttps://git.weboob.org/weboob/weboob/commit/19a0bf8f2e781a0a641d7d6f866bdeaded01c9d4[boursorama] Handle users without accounts2018-12-02T12:31:01+01:00Martin Sicotmartin.sicot@budget-insight.com
Some users add their connection but there isn't any accounts on the
website...?
Closes: 20861@sibihttps://git.weboob.org/weboob/weboob/commit/2ab69da5ca4106df00816057e5da4922f97e81dd[capabilities/bank/test] Don't check code_type if code = "XX-liquidity"2018-12-02T12:30:48+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
Everytime we test a module handling liquidities we have this error:
"Investment "Liquidités" has code but no code_type"
This error is pointless since the "Liquidités" code_type is always
NotAvailable so I precised in the "if inv.code" to check if the inv.code
is not "XX-liquidity".https://git.weboob.org/weboob/weboob/commit/f13752e86b90e7b3d04f04ceb3c9aa9fd87ea635[boursorama] Avoid iter_recipients for Loan and Life insurance2018-12-02T12:30:41+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
Closes: 1013621@redminehttps://git.weboob.org/weboob/weboob/commit/e63b54bdea1df6d09d5d3294ba49a7a9dfb8821f[hsbc] Revised account typing using Regexps2018-12-02T12:30:33+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
The account typing was sometimes biaised by the person's name:
for example, if the label is "Compte Mr Pelletier", it will find "pel"
in the label and therefore type it as a "PEL".
The Regexp looking for actual words should reduce wrong account typing.
Closes: 8229@zendeskhttps://git.weboob.org/weboob/weboob/commit/c6168eae451f191f848098a81478a60904a92f94[boursorama] Corrected URLs for Loans2018-12-02T12:30:24+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.com
Loans are fetched on a loan detail page and the correponding account is
removed from the accounts_list, however it is crucial to add the loan
url for other methods in the module such as iter_transfer_recipients
that start with "assert account.url" and get_invest that starts with "if
/blabla/ in account.url".
Closes: 28577@sibihttps://git.weboob.org/weboob/weboob/commit/239bdb34900248823bbd2f37bd3de5dfb91c2169[boursorama] Corrected indentation mistake2018-12-02T12:30:17+01:00Quentin Defenouillerequentin.defenouillere@budget-insight.comhttps://git.weboob.org/weboob/weboob/commit/fac5be529122a11b6d6fbf26b42d7b965c694396[smc] handle GDPR ActionNeeded2018-12-02T12:30:07+01:00Sylvie Yesye@budget-insight.comhttps://git.weboob.org/weboob/weboob/commit/344415a17542fbf3ba71124e239d4b3fad3f36b7[boursorama] handle paid off loans / no next_payement_date2018-12-02T12:29:59+01:00Martin Sicotmartin.sicot@budget-insight.com
handle loans paid off without a next_payement_date.https://git.weboob.org/weboob/weboob/commit/76919d4f66083c8fa1f91da606dacaf816382319[creditmutuel] Skip some cards2018-12-02T12:29:51+01:00Maxime Gasselinmaxime.gasselin@budget-insight.com
Some undesirable cards get the precedent xpath condition. The
criteria is now if there is coming. Ex: 'Dépenses de novembre'.
Closes: 28173@sibi 8134@zendeskhttps://git.weboob.org/weboob/weboob/commit/cc0fc417d0b2d081803fd325d33a17f97e7fe849[oAuth2] new BrowserRedirect exception2018-12-02T12:29:38+01:00Etienne Lachereetienne.lachere@budget-insight.commeant to work with oAuth2 compliant modules. The module constructs the
authorization_uri with every params it needs (at least client_id and redirect_uri),
then raise BrowserRedirect with this uri.https://git.weboob.org/weboob/weboob/commit/3c6e3ecb2f9261b9ad874641dc5191b6f08a17fc[lcl] handle accounts typing with more flexibility2018-12-02T12:29:26+01:00Frédéric Lépyfrederic.lepy@budget-insight.com