hn_throwaway_99
a year ago
Tell that to Synapse customers. Many millions of dollars are missing.
Banks have to follow strict rules to account for where all the money goes. But the way fintechs work, they usually just have one or a couple underlying "FBO" accounts where all the pooled money is held, but then the fintech builds a ledger on top of this (and, as the article points out, to varying levels of engineering competence) to track each individual customer's balance within this big pool of money. In Synapse's case, their ledger said the total amount of all of their individual customer balances ended up being much more than the actual funds held in the underlying FBO accounts. Lots of folks are assuming fraud but I'm willing to put money that it was just a shitty, buggy ledger.
FWIW, after seeing "how the sausage is made", I would never put money into a fintech depository account. Use a real bank. Fintechs also often put out the fake promise that deposits are FDIC insured, but this only protects you if the underlying bank goes belly up, not if the fintech loses track of your money.
See https://www.forbes.com/sites/zennonkapron/2024/11/08/what-th...
chairmansteve
a year ago
90 million dollars missing and 250 million dollars frozen. That 250m probably needed by some people to pay rent.
Backed by Andreesen Horowitz who are conducting a scorched earth jihad against all government regulation.
https://finance.yahoo.com/personal-finance/synapse-bankruptc...
abirch
a year ago
The sad thing is that most people don't learn lessons from history. It took me far too long to start learning lessons from history.
After an asset bubble and collapse people will understand why we have a lot of the regulations from the 1930s.
manquer
a year ago
Sadly I don’t think it will happen.
In previous crises people could depend being educated by mostly responsible media . Today both mainstream and social are entertainment first don’t care for truth or their role in educating the society .
It is more likely they will be taught to blame some boogeymen who have nothing to do with the problem rather address the real one .
figassis
a year ago
You will. Your kids won’t.
bboygravity
a year ago
That's not really a lot compared to what Wallstreet is steeling daily.
ozim
a year ago
Ugh that’s not a quality on its own.
Someone who „steals less” is not better.
Still fucking thieves.
ozim
a year ago
You do understand what you described is basically Bolshevik/French revolution only different times.
Some men with some power using young starry eyed young people to grab much more power from incumbents.
user
a year ago
mrfox321
a year ago
At a big co I worked at, the lack of consistency between trading systems caused money to (dis)appear (into)out of thin air.
Prior to one of these hiccups, I hypothesized, given how shitty the codebase was, that they must be tracking this stuff poorly.
This led to an argument with my boss, who assumed things magically worked.
Days later, we received an email announcing an audit one one of these accounting discrepancies.
JPMC proposed using crypto, internally, to consistently manage cash flow.
Not sure if it went anywhere.
HolyLampshade
a year ago
At all of the exchanges and trading firms I’ve worked with (granted none in crypto) one of the “must haves” has been a reconciliation system out of band of the trading platforms. In practice one of these almost always belongs to the risk group (this is usually dependent on drop copy), but the other is entirely based on pcaps at the point of contact with every counterparty and positions/trades reconstructed from there.
If any discrepancies are found that persist over some time horizon it can be cause to stop all activity.
ajb
a year ago
Wait, pcap as in wireshark packet capture?
SnorkelTan
a year ago
Looking at the order messages sent to and received from another trading system was not uncommon when I worked in that neck of the woods
chairmansteve
a year ago
The crypto firms are moving fast and breaking things. No need for that kind of safety shit, right? Would slow things down. Reminds me of Boeing.
nobodyandproud
a year ago
So is this capture used to reconstruct FIX messages?
phire
a year ago
Fun fact, centralized crypto exchanges don't use crypto internally, it's simply too slow.
As a contractor, I helped do some auditing on one crypto exchange. At least they used a proper double-entry ledger for tracking internal transactions (built on top of an SQL database), so it stayed consistent with itself (though accounts would sometimes go negative, which was a problem).
The main problem is that the internal ledger simply wasn't reconciled with with the dozens of external blockchains, and problems crept in all the time.
oblio
a year ago
> Fun fact, centralized crypto exchanges don't use crypto internally, it's simply too slow.
I know you're not arguing in their favor, just describing a reality, but the irony of that phrase is through the roof :-)))
Especially the "centralized crypto".
naasking
a year ago
> JPMC proposed using crypto, internally, to consistently manage cash flow.
Yikes, how hard is it to just capture an immutable event log. Way cheaper than running crypto, even if only internally.
imglorp
a year ago
Harder than you'd think, given a couple of requirements, but there are off the shelf products like AWS's QLDB (and self hosted alternatives). They: Merkle hash every entry with its predecessors; normalize entries so they can be consistently hashed and searched; store everything in an append-only log; then keep a searchable index on the log. So you can do bit-accurate audits going back to the first ledger entry if you want. No crypto, just common sense.
Oddly enough, I worked at a well known fintech where I advocated for this product. We were already all-in on AWS so another service was no biggie. The entrenched opinion was "just keep using Postgres" and that audits and immutability were not requirements. In fact, editing ledger entries (!?!?!?) to fix mistakes was desirable.
limit499karma
a year ago
Theoretically they even have a better security environment (since it is internal and they control users, code base and network) so the consensus mechanism may not even require BFT.
hooverd
a year ago
It's all merkle trees under the hood. I feel like the crypto coin stuff has overshadowed the useful bits.
trog
a year ago
Is a Merkle tree needed or is good old basic double ledger accounting in a central database sufficient? If a key requirement is not a distributed ledger then it seems like a waste of time.
csomar
a year ago
Crypto/Blockchain makes it harder to have an incorrect state. If you fk up, you need to take down the whole operation and reverse everything back to the block in question. This ensures that everything was accounted for. On the other hand, if you fk in a traditional ledger system you might be tempted to keep things running and resolve "only" the affected accounts.
im3w1l
a year ago
If its for internal why not just use a normal append only log. x amount transferred from account y to account z. A three column csv oughta do it.
sneak
a year ago
Any time your proposal entails a “why not just”, it is almost certainly underestimating the mental abilities of the people and teams who implemented it.
A good option is “what would happen if we” instead of anything involving the word “just”.
tonyhart7
a year ago
it literally ledger, its only show where money went but not showing "why" the money move
double entry with strong check that ensure its always balance fix this
foobarbecue
a year ago
DanielHB
a year ago
> I hypothesized, given how shitty the codebase was, that they must be tracking this stuff poorly.
That is like half of the plot of Office Space
mlloyd
a year ago
This sounds like a situation that I know about at the placed identified by name in your comment. It took months to track down the issue.
phonon
a year ago
Synapse says that it was actually the Bank (Evolve) that made the accounting mistakes, including missing transactions, debits that weren't reported, sending in flight transaction to Mercury while debiting Synapse incorrectly etc.
https://lex.substack.com/p/podcast-what-really-happened-at-s...
hn_throwaway_99
a year ago
Thanks for posting this, I will definitely listen to it.
While I haven't listened yet, one thing I don't really buy when it comes to blaming Evolve is that it should fundamentally be Synapse's responsibility to do reconciliation. This is what completely baffled me when I first worked with another BaaS company - they weren't doing any reconciliation of their ledgered accounts with the underlying FBO balances at the partner bank! This was insane to me, and it sound likes Synapse didn't do it either.
So even if Evolve did make accounting mistakes and have missing transactions, Synapse should have caught this much earlier by having regular reconciliations and audits.
phonon
a year ago
They claim they did, Evolve kept putting them off, until they ran out of money.
There's a full transcript (with some images) below the player btw.
rawgabbit
a year ago
Rambling interview. As best as I can tell Synapse said there were technical issues with Evolve the bank.
Meanwhile this article said Synapse withdrew from Evolve the end user funds. Mr. Holmes of Evolve said the bank “transferred all end user funds” to other banks at the request of Synapse, but declined to identify them
https://www.nytimes.com/2024/07/09/business/synapse-bankrupt...
phonon
a year ago
I'm sure the spokesperson for Evolve who then says "“It’s complicated,” he wrote in an email Friday, declining to elaborate further."" is fully trustworthy and not eliding any important details.
zimbatm
a year ago
Wise also recently switched their US bank provider from Evolve to Community Federal Savings Bank. Maybe they had similar issues?
Aspos
a year ago
I see no reason why CFSB would be in any way different from Evolve, they are just not caught up in the mess yet.
Synapse problem was fundamental and it stems from the same mistake OP is making: never ever build your own, homegrown ledger if you can avoid it.
abenga
a year ago
From a cursory look at how it describes itself (BaaS, etc), Evolve is hardly a "bank" in the traditional sense of the word.
hipadev23
a year ago
Sankaet is full of shit.
hgomersall
a year ago
I had money disappear from my HSBC account. As in, the double entries didn't match by a small amount (it was a payment between two of my accounts that didn't match up, which I couldn't trivially reconcile in the books). I pursued this for a while but they never even properly acknowledged it let alone fix it.
I had my unfounded suspicion it was some internal subtle theft going on, but incompetence is probably a better explanation.
tossandthrow
a year ago
If you live in a developed country it should be sufficient to ask them to account for it with a note that a formal complaint will be sent to relevant authorities if nor dealt with in timely manner.
That stuff like this is in order is the foundation of kapital societies and is taken quite seriously.
hgomersall
a year ago
You'd think so wouldn't you? But alas, the effort required to solve this was at least more than I was willing to make.
pera
a year ago
I had a similar situation with Santander many years ago: it was a small amount and happened when I was closing my account, bank manager couldn't explain it and escalating the problem was a pain - especially because I was about to move to another country and had more urgent things to do.
I wonder how common issues like these are...
imp0cat
a year ago
I think it's quite common, it's just that people do not notice these things.
I also had it happen one time, the bank eventually figured it out and fixed some error on their part.
lores
a year ago
You're likely correct it was theft. I was told by a CTO there that topping up accounts with bank money where it has been hacked away was daily routine and cheaper than fixing the systems. Incompetence would not manifest on routine operations like this.
DanielHB
a year ago
> I had my unfounded suspicion it was some internal subtle theft going on
Had you watched Office Space recently?
user
a year ago
TexanFeller
a year ago
I’m skittish about real banking institutions as well. Vanguard for example outsourced a bunch of their dev work to India a few years ago. Had a friend that worked as a sysadmin for BoA. They were required to keep certain logging for 7 years but he would just delete it anyway when disks were starting to get full.
hn_throwaway_99
a year ago
But the fundamental difference is that the regulatory structures are in place to recover your money if a bank loses it. That's not the case with fintech middlemen. Take the Synapse case:
* End customers are really a customer of Yotta, a (silly IMO) fintech where interest was essentially pooled into a sweepstakes prize.
* Yotta was a customer of Synapse - they used Synapse BaaS APIs to open customer accounts (again, these accounts were really just entries in Synapse's ledger, and they underlying funds were supposed to be stored in an FBO account on Evolve).
* Synapse partnered with Evolve, who is the FDIC insured bank.
Synapse went bankrupt, and Yotta customers are finding out they can't access their money. But the bankruptcy court is at a loss as to really what to do. FDIC isn't getting involved, because as far as they can tell, Evolve hasn't failed. Synapse is basically out of the picture at this point as they are bankrupt and there isn't even enough money left to do a real audit, and Yotta is suing Evolve alleging they lost customer funds. But, in the meantime, Yotta customers are SOL.
If you had a direct relationship with an FDIC-insured bank, and they lost your money, there would be a much clearer path for the FDIC to get involved and make you whole (up to $250k).
HWR_14
a year ago
There are regulatory structures in place for if your bank goes insolvent. AFAIK there is no regulatory mechanism for "I think The bank owes me $1MM dollars; they think I am not a customer". That's just a lawsuit.
itake
a year ago
FDIC would only get involved if the bank was insolvent?
If your bank and you have a disagreement over how much money should be in your account, then FDIC wouldn't be involved?
Thorrez
a year ago
How about Wealthfront Cash accounts? Wealthfront provides me a statement that shows how my deposited money is distributed among its FDIC insured partner banks, and each transfer they do to and from one of those partner banks. Wealthfront does use a middleman, somewhat similar to how Yotta used Synology as a middleman. But Wealthfront's middleman is FDIC insured: Green Dot Bank.
tw04
a year ago
> They were required to keep certain logging for 7 years but he would just delete it anyway when disks were starting to get full.
I’m highly skeptical of this claim. Every bank I’ve worked with adheres to their records requirements like it’s life or death (because it kind of is for the bank).
Tell your friend he’s exposing himself to hard prison time if he’s not just making up a story. If his boss tells him that they don’t have budget to retain the logs he should be whistle blowing, not violating federal banking laws to save what is a rounding error in their IT budget.
user
a year ago
superzamp
a year ago
Coincidentally written something about this yesterday [1], but the gist of my take summed up is that the nature of accounting oriented data models doesn’t help when dealing with multiple FBO accounts.
The main problem is that accounting defaults to full fungibility of monetary amounts represented in a ledger, which has the effect of losing track of the precise mapping between assets and liabilities, so you end up in a position where you simply cannot tell precisely to a bank _who_ are the actual customers they owe money to.
[1] https://www.formance.com/blog/engineering/warehousing-promis...
ThinkingGuy
a year ago
I like Cory Doctorow's saying: "When you hear the term 'fintech,' think 'unlicensed bank.'
chairmansteve
a year ago
"Fintechs also often put out the fake promise that deposits are FDIC insured, but this only protects you if the underlying bank goes belly up, not if the fintech loses track of your money".
Would you count Wealthfront as a fintech? I was finding their marketing compelling, but this thread makes me think twice.
hnthrowaway7394
a year ago
There is a pretty fundamental difference, and it’s that Wealthfront (and M1, Robinhood, Fidelity, etc) are registered broker-dealers. Broker-dealers are regulated just as stringently as banks, but by the SEC and FINRA as opposed to the Fed. Broker-dealers have been running passthrough FDIC programs for decades, and in a lot of ways have more stringent regulations than banks. The most notable is that they are forced to segregate assets (can’t put client assets on the balance sheet, they have to custody them separately), which is the ultimate way banks fail and need the FDIC to bail them out. Source: used to work in broker-dealer auditing
dmoy
a year ago
Yes, it's the same basic principle going on at Wealthfront/etc.
It's possible (probable?) that they have better accounting controls. But I personally wouldn't keep anything above SIPC limits at Wealthfront (or any near competitor like Robinhood, M1, etc). And I'd be keeping records on my own.
And I'd make peace with the fact that SIPC resolution is a completely different ballgame from FDIC turnaround for assets held directly at an insured bank (which is like single business day don't-even-notice fast). I.e. not use it as the sole source of emergency funds, have months of expenses at a different institution, etc.
dmoy
a year ago
> same basic principle
Well yes and no - synapses pass-through-banking wasn't covered by SIPC, and neither would wealthfronts comparable product. But keeping it just in a standard Wealthfront (or synapse even) sweep account with no underlying banking shenanigans happening, is different from SIPC's perspective.
Just keeping stocks (up to $500k) or sweep (up to $250k) at a SIPC broker is probably okay, even if it's a new fintech. Fooling around with their weird passthrough stuff, less so.
eweise
a year ago
In addition to a ledger, fintechs need a reconciliation system to ensure the ledger is correct. Does the card processor audit files match your ledger? Does your ACH and check processing systems match the ledger? What about external money movements at the sponsor bank. Are they recording in the ledger?
ajuc
a year ago
> In Synapse's case, their ledger said the total amount of all of their individual customer balances ended up being much more than the actual funds held in the underlying FBO accounts. Lots of folks are assuming fraud but I'm willing to put money that it was just a shitty, buggy ledger.
Bugs are as likely to show more and less money than there really are. But bugs in production will almost always show more :)
e40
a year ago
I had been debating the merits of using Flourish, but I'm sticking with SNOXX on Schwab. Same rate and I think SNOXX has to be safer, right? Even with the Flourish FDIC guarantee, as others have pointed out, it's only for the underlying back not Flourish itself.
bradleyjg
a year ago
In Synapse's case, their ledger said the total amount of all of their individual customer balances ended up being much more than the actual funds held in the underlying FBO accounts. Lots of folks are assuming fraud but I'm willing to put money that it was just a shitty, buggy ledger.
If there was no malfeasance then no money would be gone. The totals would add up, they just wouldn’t no know who was owed what. Since the totals don’t add up, someone got the extra.
throwaway2037
a year ago
> Fintechs also often put out the fake promise that deposits are FDIC insured
Does this still happen?koblas
a year ago
Many fintechs are not licensed to hold funds and work with bank partners who hold your actual funds. That allows them to say they're insured because they're not co-mingled with the corporate funds in the event of insolvency. This doesn't stop them from making accounting errors.
zie
a year ago
The FDIC said you can't do this anymore starting Jan 1, 2025. So I expect it to stop in about 30 days. The FDIC will probably find a few laggards and throw some fines at them, and the process will then probably completely stop.
fragmede
a year ago
the problem is the discrepancy between what the Fintech means when they say fdic insured, and what the customer hears when they're told fdic insured. the customer (erroneously) assumes it means that if the Fintech or anyone else has problems, the customer is covered up to the 250k fdic limit. what the Fintech means, is that there's someone they're partnered with that is a bank and is fdic covered. How the money is deposited into the bank is up for interperation. if there Fintech is being dishonest, they have one bank account at a bank, and all of the customers money goes into that one shared account, they're not technically lying - the money is fdic insured. unfortunately for the customers, that's not the same as each of them being fdic insured is the Fintech goes under. fdic doesn't seem to want to clarify this issue either, which is a problem.
moffkalast
a year ago
The fact that practically all funding most of the world runs on these days is just a bunch of variables in some shitty program never stops being weird to think about. All it takes to create or destroy trillions is one (or maybe a few) CPU ops.
It really stretches the belief into fiat money to the absolute limit.
bitwize
a year ago
Dade: This is every financial transaction Ellingson conducts, yeah? From million dollar deals to the ten bucks some guy pays for gas.
Kate: The worm eats a few cents from each transaction.
Dade: And no one's caught it because the money isn't really gone. It's just data being shifted around.
PittleyDunkin
a year ago
> Lots of folks are assuming fraud but I'm willing to put money that it was just a shitty, buggy ledger.
I'm not sure there's much difference. Intent only matters so much.
taeric
a year ago
I mean... Fraud is defined by intent.
You can argue negligence over mistake. But fraud definitely requires intent.
user
a year ago
PittleyDunkin
a year ago
I guess my point is it's as harmful as fraud regardless if we can throw someone in prison.
serbuvlad
a year ago
> In Synapse's case, their ledger said the total amount of all of their individual customer balances ended up being much more than the actual funds held in the underlying FBO accounts.
When the banks do this it's called "fractional reserve banking", and they sell it as a good thing. :)
Aurornis
a year ago
I’m constantly amazed by how much the crypto community thinks they understand fractional reserve banking while getting it so completely wrong.
In fractional reserve banking, money that is loaned out is accounted for as liabilities. These liabilities subtract from the overall balance stored (reserved) at the bank. The bank is not printing money new money, no matter how many times this idea gets repeated by people who are, ironically, pumping crypto coins that were printed out of thin air.
I think it’s incredible that cryptocurrencies were literally manifested out of bits, but the same people try to criticize banks for doing this same thing (which they don’t).
simula67
a year ago
> The bank is not printing money new money, no matter how many times this idea gets repeated by people who are, ironically, pumping crypto coins that were printed out of thin air.
It is now widely accepted that bank lending produces new money[1][2]
[1] https://www.bankofengland.co.uk/-/media/boe/files/quarterly-...
jnwatson
a year ago
The "liabilities" aren't subtracted from the deposit amount when counted as M1 supply. (Actually loans are accounted for as assets and deposits are liabilities, but that's beside the point).
If customer A deposits $100 in cash, and customer B borrows $100 from the bank and deposits it back in the bank, M1 goes up because there are now two checking accounts with $100 in it. That the bank's internal bookkeeping balances doesn't change the fact that the Fed considers that more money exists.
throw0101a
a year ago
> In fractional reserve banking, money that is loaned out is accounted for as liabilities.
Yes, that is how a fractional reserve banking works. But that is not how the current banking system works.
* https://www.stlouisfed.org/publications/page-one-economics/2...
* https://www.pragcap.com/r-i-p-the-money-multiplier/
Banks do not lend out deposits. This was called the "Old View" by Tobin in 1963:
* https://elischolar.library.yale.edu/cowles-discussion-paper-...
The Bank of England has a good explainer on how money is created:
* https://www.bankofengland.co.uk/quarterly-bulletin/2014/q1/m...
See also Cullen Roche:
* https://papers.ssrn.com/sol3/papers.cfm?abstract_id=1905625
kevin_nisbet
a year ago
This is a good explanation, I've had to explain this topic a few times as well, it seems like it's one of those topics that is very missunderstood.
To just expand a bit, I believe some of the confusion around printing of money comes from the way some economics reports are built. As a micro example, Assume a 10% required reserve, If Alice deposits $100 and the bank lends $90 to Bob. Alice ($100 deposits) + Bob ($90 cash) think they have $190 in total.
This is mainly useful for economists to understand, study, and report on. However, when the reports get distributed to the public, it looks like the banks printed their own money, as we now see $190 on the report when there is only $100 of cash in our example system.
Whether the system should work on a fractional reserve is it's own debate, but we need to know what it is to debate the merits and risks of the system.
immibis
a year ago
In fractional reserve banking, the total deposits at a bank can be greater than the amount of physical money it holds. Since the rest of society is willing to accept bank deposits as an alternative to physical money, this is a form of printing money. Physical currency is not printed, but bank deposit currency (which is money, by de facto agreement) is.
user
a year ago
stackghost
a year ago
>These liabilities subtract from the overall balance stored (reserved) at the bank. The bank is not printing money new money
Hi, this is factually incorrect and you should educate yourself before attempting any further condescending comments on Hacker News.
no_wizard
a year ago
I just want the gold standard back.
It worked as an actual check on money supply and went implemented properly was harder to manipulate
serbuvlad
a year ago
First of all, I take offense to being thrown in as part of the crypto community, with which I have nothing to do, and for which I do not have much hope.
So now if you are unhappy with the monetary system you are automatically a crypto bro and can be dismissed?
Secondly, the problem with fractional reserve banking is as follows: Suppose Larry makes a deposit of one dollar, which the bank guarantees can be retrieved at any time. The bank loans this dollar to Catherine, which uses it to buy something from Steve. Now Steve has one dollar, which he deposits with the bank. The bank lends this dollar to Catherine2, which uses it to buy something from Steve2. And so on, up to CatherineN and SteveN
Now, in so far as transactions can take place in the economy with bank IOUs, which are considered perfect money substitutes, the amount of money in the economy has been multiplied by a factor of N. Where before only Peter had a dollar (or a dollar IOU, which are supposedly the same), now Pere AND Steve, Steve2, up to SteveN all have a dollar IOU. This leads to an inflationary pressure.
Now it is true that upon the Catherine's repaying of the debt, these extra dollars will go away. However, in reality there is no such thing as negative dollars. The supply of money has been increased by the bank.
An objection could be raised that Catherine's extra demand for money to pay off her debt will exactly offset the extra supply of money. This is nonsense! Everyone demands money all the time. If Catherine did not demand money to pay off her loan, she would demand money in order to satisfy her next most urgent want which could be satisfied by money. The increase in the demand for money is negligible.
victorbjorklund
a year ago
But Banks are increasing the money supply with fractional reserve bank. But that is of course on purpose and account for by the govt.
willmadden
a year ago
The bank IS printing new money. You are ignoring the money multiplier effect where the money lent by bank 1 is deposited into bank 2, bank 2 lends 90% of that deposit, which is deposited into bank 3, ... repeating the process over and over.
With a 10% reserve requirement, a 1,000,000 USD deposit will result in up to 10 times that much money being lent out.
The formula is 1/r, where r is the reserve requirement.
zmgsabst
a year ago
Clarifying question:
So for every $1 deposited, I can lend $0.90 but must hold $0.10 as my reserve?
thaumasiotes
a year ago
There's more to it than that; balances are exceeded by the sum of "assets held by the bank" and "assets owed to the bank".
user
a year ago
Shalah
a year ago
@serbuvlad: “When the banks do this it's called "fractional reserve banking", and they sell it as a good thing. :)”
How dare you criticize our holy banking system /s