Benford's Law - this is great

Project Management, Agile Methodologies, Scrum, Software Development, Software Architecture Styles, Development Platforms, and more...
Post Reply
User avatar
JimLombard
Casual User
Casual User
Posts: 15
Joined: Tue May 27, 2014 2:40 am

Benford's Law - this is great

Post by JimLombard »

I just happened to be reading an old article about it and it peaked my interest. I guess not too many people (even statisticians) were too familiar with it up until 10-15 years ago, but it is getting very popular as it is being used to detect fraud in corporations, tax documents, etc. by simply looking at the numbers involved.

I know this is a bit out of topic for these forums, but I think it's such an interesting topic, that I wanted to tell people about it. See attached documents below.
Attachments
RFewster_Benford.pdf
(756.76 KiB) Downloaded 1755 times
BenfordsLaw03.PDF
(698.7 KiB) Downloaded 1785 times
Luck is not a factor. Hope is not a strategy. Fear is not an option - James Cameron
User avatar
Bill_WG
Casual User
Casual User
Posts: 10
Joined: Fri May 23, 2014 1:59 am

Re: Benford's Law - this is great

Post by Bill_WG »

This is indeed off topic, as far as the forum goes, but is a very interesting topic to me. I also only recently became aware of Benford's Law and am fascinated with it!

I have seen many mentions of it having been used in real legal cases, but have not been able to find and case law for it. Do you happen to know of any such cases? I'd love to read up on them.
User avatar
OscarG
Active User
Active User
Posts: 34
Joined: Thu Jun 06, 2013 7:45 pm

Re: Benford's Law - this is great

Post by OscarG »

Not sure how well this theory applies to the real world. I run a simulation by creating 1.2 million random numbers in the range 1-99999 in excel and then analyzed the first digit (1-9) frequency. I ended up with about 11% for each digit, totally different than what Benford's law suggested.

Am I doing something wrong?
I have not failed. I’ve just found 10,000 ways that won’t work - Thomas A. Edison
User avatar
CindyLak
New User
New User
Posts: 7
Joined: Thu Jun 12, 2014 11:21 pm

Re: Benford's Law - this is great

Post by CindyLak »

Oscarg, my findings are similar to yours. I am sure there is a logical explanation, I just don't know what it is.

If anyone here can shed some light, it would be great!
Vegetarian: Indian word for lousy hunter
User avatar
PLeonat
Frequent User
Frequent User
Posts: 55
Joined: Wed Oct 26, 2011 9:48 pm

Re: Benford's Law - this is great

Post by PLeonat »

Wait, isn't that exactly what his premise is? That "made up" numbers are not random, in terms of the first digit?

I may have totally misread this, but I think what you found proves his point.
User avatar
CindyLak
New User
New User
Posts: 7
Joined: Thu Jun 12, 2014 11:21 pm

Re: Benford's Law - this is great

Post by CindyLak »

Hmm, you may be right. Have you looked at anything yourself that sort of proves his theory?
Vegetarian: Indian word for lousy hunter
User avatar
PLeonat
Frequent User
Frequent User
Posts: 55
Joined: Wed Oct 26, 2011 9:48 pm

Re: Benford's Law - this is great

Post by PLeonat »

Yes, I had looked at it a while ago and I had analyzed the populations of 227 countries in 1950. It was a quick and dirty thing, but here is what the results looked like: Pretty good, IMO. The first digit frequencies seem to agree with Benford's law.

BenfPop1950.PNG
BenfPop1950.PNG (13.2 KiB) Viewed 43523 times
User avatar
BLarson
Casual User
Casual User
Posts: 12
Joined: Sat May 24, 2014 10:55 pm

Re: Benford's Law - this is great

Post by BLarson »

Well, I don't know how helpful it is, but I found another short paper on this site's "techs" section that deals with this subject.

http://triusinc.com/techs/QuickBenford_Karahalios.pdf

It's fairly simple and doesn't go deep into math, but it may provide some additional insight.
User avatar
PLeonat
Frequent User
Frequent User
Posts: 55
Joined: Wed Oct 26, 2011 9:48 pm

Re: Benford's Law - this is great

Post by PLeonat »

BLarson wrote: Thu Nov 16, 2017 4:42 am Well, I don't know how helpful it is, but I found another short paper on this site's "techs" section that deals with this subject.

http://triusinc.com/techs/QuickBenford_Karahalios.pdf

It's fairly simple and doesn't go deep into math, but it may provide some additional insight.


Wow, actually, the plot from the paper you references (see below) displays similar behavior to what I had looked at. Does that constitute Independent verification?
:-)

Benford_Graph_Karahalios.PNG
Benford_Graph_Karahalios.PNG (35.95 KiB) Viewed 43492 times
User avatar
CindyLak
New User
New User
Posts: 7
Joined: Thu Jun 12, 2014 11:21 pm

Re: Benford's Law - this is great

Post by CindyLak »

I found this very interesting real-life case study of Benford's Law.

https://acfeinsights.squarespace.com/ac ... case-study
Vegetarian: Indian word for lousy hunter
Post Reply