User doublejay - MathOverflow most recent 30 from http://mathoverflow.net 2013-06-18T21:19:43Z http://mathoverflow.net/feeds/user/942 http://www.creativecommons.org/licenses/by-nc/2.5/rdf http://mathoverflow.net/questions/24526/good-papers-books-essays-about-the-thought-process-behind-mathematical-research Good papers/books/essays about the thought process behind mathematical research DoubleJay 2010-05-13T17:49:36Z 2013-03-19T13:13:52Z <p>Papers in mathematics are generally written as if the major insights suddenly appeared, unbidden, in a notebook on the researcher's desk and then were fleshed out into the final paper.</p> <p>While this is great for finding out about results, it's terrible for finding out about how they were arrived at. </p> <p>What I want are papers, books or essays written by researchers about their work on problems, especially if they describe the evolution of their work on a specific problem (Polya's writings on problem-solving are great, but not what I'm interested in). I'd like to know how hundred-page treatises on problems unsolved for decades are born.</p> http://mathoverflow.net/questions/54007/is-there-any-straightforward-way-to-substitute-for-gaussian-brownian-assumptions Is there any straightforward way to substitute for Gaussian/Brownian assumptions in financial mathematics? DoubleJay 2011-02-01T18:01:50Z 2013-03-01T23:00:02Z <p>A huge amount of financial mathematics assumes Gaussian distributions of risks and Brownian movement of prices. What efforts have there been to replace these with heavy-tailed distributions? For example, could Black-Scholes be adjusted to assume heavy-tailed distribution of price movements, or is this too mathematically difficult?</p> http://mathoverflow.net/questions/5781/graphs-with-fractal-properties Graphs with fractal properties? DoubleJay 2009-11-17T05:22:42Z 2013-02-06T08:19:19Z <p>For the purposes of a research project, I am wondering if there are any resources on graphs with fractal properties, by which I mean self-similarity in particular. For instance, imagine a graph where nodes could be transformed into subgraphs that were the same as the larger graph, and their nodes could be transformed likewise, etc. I don't mean a graph that is literally exactly like that - but it should have self-similarity at different levels as if it had been created that way, with maybe a little randomness thrown in afterwards.</p> <p>I was told that Expander graphs were something like what I was looking for, but from what little I understand of their definition, they seem more related to small-world theory than to what I'm looking for.</p> <p>Edit: I'm because I'm trying ot figure out a way in which representations of social and geographic networks of people could be compressed, probably with significant loss but maintaining basic properties.</p> http://mathoverflow.net/questions/13750/what-are-the-applications-of-hypergraphs What are the Applications of Hypergraphs DoubleJay 2010-02-01T23:47:10Z 2012-09-20T08:28:05Z <p><a href="http://en.wikipedia.org/wiki/Hypergraph" rel="nofollow">Hypergraphs</a> are like simple graphs, except that instead of having edges that only connect 2 vertices, their edges are sets of any number of vertices. This happens to mean that all graphs are just a subset of hypergraphs.</p> <p>It strikes me as odd, then, that I have never heard of any algorithms based on hypergraphs, or of any important applications, for modeling real-world phenomena, for instance. I guess that the superficial explanation is that it's a much more complex structure than a regular graph, and given this and its generality it's harder to make neat algorithms for, but I would expect there to be something!</p> <p>Has anyone heard of a hypergraph-based algorithm, or application? It perplexes me that ordinary graphs can be so wonderfully useful, but their big brothers have nothing to offer.</p> http://mathoverflow.net/questions/10358/solving-np-problems-in-usually-polynomial-time Solving NP problems in (usually) Polynomial time? DoubleJay 2010-01-01T07:58:37Z 2012-03-03T21:49:14Z <p>Just because a problem is NP-complete doesn't mean it can't be usually solved quickly.</p> <p>The best example of this is probably the traveling salesman problem, for which extraordinarily large instances have been optimally solved using advanced heuristics, for instance sophisticated variations of <a href="http://en.wikipedia.org/wiki/Branch%5Fand%5Fbound" rel="nofollow">branch-and-bound</a>. The size of problems that can be solved exactly by these heuristics is mind-blowing, in comparison to the size one would naively predict from the fact that the problem is NP. For instance, a tour of all 25000 cities in Sweden has been solved, as has a VLSI of 85900 points (see <a href="http://www.tsp.gatech.edu/pla85900/index.html" rel="nofollow">here</a> for info on both).</p> <p>Now I have a few questions:</p> <p>1) There special cases of reasonably small size where these heuristics either cannot find the optimal tour at all, or where they are extremely slow to do so?</p> <p>2) In the average case (of uniformly distributed points, let's say), is it known whether the time to find the optimal tour using these heuristics is asymptotically exponential n, despite success in solving surprisingly large cases? Or is it asymptotically polynomial, or is such an analysis too difficult to perform?</p> <p>3) Is it correct to say that the existence of an average-case polynomial, worst-case exponential time algorithm to solve NP problems has no importance for P=NP?</p> <p>4) What can be said about the structure of problems that allow suprisingly large cases to be solved exactly through heuristic methods versus ones that don't? </p> http://mathoverflow.net/questions/11113/how-important-are-publications-for-undergrads How important are publications for undergrads? DoubleJay 2010-01-08T06:28:03Z 2012-02-21T14:36:02Z <p>I have heard vastly conflicting statements about whether undergrads applying for PhD programs should have published already, or what level of research will be expected of them. Looking at CVs of some of my school's professors, almost none of them seem to have publications from earlier than the 2nd half of their graduate studies, meaning they spent most of their time before getting their PhD without any publications or those that they had weren't worth listing, in their eyes.</p> <p>Obviously, I'm going to try to get the best experience I can as an undergrad, and I hope that means getting published research, but in every area I've dipped my toe in, from probability to dynamical systems to complexity theory, the sheer amount of additional knowledge I'd need to understand even a upper-level graduate text seems intimidating.</p> <p>When did you first publish, and what sort of research experience (if it's something other than publishing an article) should an undergraduate aiming for a PhD have?</p> <p>Disclaimer: I'm an undergrad in CS, pretty average or maybe above average in my progress so far, and I'd like to make a career in researching some of the theoretical (and obviously math-heavy) parts of computer science, rather than software or interface.</p> http://mathoverflow.net/questions/31789/statistical-physics-of-string-theory Statistical physics of string theory DoubleJay 2010-07-14T03:49:04Z 2012-02-15T16:39:33Z <p>Is there any connection between statistical physics and string theory, or a statistical interpretation of string theory, perhaps? I mean, the way electromagnetic forces and thermodynamic laws are described as emerging are all describable by statistical physics formulations. String theory accounts for gravity (I don't really know where the other two fit in), but does it do so (or is there any effort to develop a formulation) in a way reminiscent of statistical physics?</p> <p>If this is a silly question, please explain why.</p> http://mathoverflow.net/questions/82918/are-there-intuitive-classically-algorithmic-analogues-to-semidefinite-programs-on Are there intuitive/classically algorithmic analogues to Semidefinite programs on networks? DoubleJay 2011-12-07T23:20:54Z 2011-12-08T08:51:06Z <p>Many network optimization algorithms, including shortest path, push-relabel, augmenting path, etc, actually have an interpretation in terms of linear programming.</p> <p>A famous application of semidefinite programming is the max-cut approximation. Does this optimization algorithm, or any other on networks, have a network interpretation, a la augmenting path?</p> http://mathoverflow.net/questions/79010/l1-regularized-least-squares-on-a-matrix-with-toeplitz-blocks-not-block-toeplitz L1-regularized Least Squares on a matrix with Toeplitz Blocks (not block-Toeplitz) DoubleJay 2011-10-24T18:58:43Z 2011-10-24T18:58:43Z <p>I am trying to speed up a sparse signal recovery algorithms.</p> <p>My sensing matrix is a set of Toeplitz Blocks, M = [T1,T2,T3,...,Tk]</p> <p>The objective is min ||Mx - b||_2^2 + ||x||1</p> <p>What I'm actually doing is trying to encode an image with multiple patch-like bases, each of which can be centered anywhere on the image.</p> <p>Is there any structure of my M = [T1,...,Tk] sensing matrix that I can take advantage of? For instance, can I efficiently compute (MM')^(-1/2) or do any other useful structure I can take advantage of to speed this up beyond naive applications (adapted to us the convolution operator) of other sparse recovery algorithms?</p> http://mathoverflow.net/questions/77206/mathematical-programming-with-other-algebras-than-linear Mathematical Programming with other Algebras than Linear DoubleJay 2011-10-05T06:05:18Z 2011-10-06T12:42:48Z <p>Linear Programming is strongly entwined with linear algebra, as are many of its generalizations under the heading of mathematical programming / convex optimization.</p> <p>What analogies are there for convex optimization techniques outside of vector spaces dealt with in linear algebra. For example, Gaussian Elimination is generalized by Buchberger's algorithm for finding Groebner bases (or so I'm told); is there any algorithm that has a relationship with Buchberger's analogous to the Simplex Method's relationship with Gaussian Elimination?</p> http://mathoverflow.net/questions/73931/estimating-the-fractal-dimension-of-a-point-cloud Estimating the fractal dimension of a point cloud DoubleJay 2011-08-29T00:36:19Z 2011-08-29T16:52:06Z <p>I have finite set of geolocation point data, and I'd like to estimate the fractal dimension. I know there are several ways to do this, and some of them give different numbers. What is the most appropriate fractal dimension to look at and what method do you recommend I use to estimate it numerically?</p> <p>Thanks</p> http://mathoverflow.net/questions/71188/probabilistic-and-other-mathematical-methods-of-physics-without-the-physics Probabilistic (and other mathematical) methods of physics without the physics? DoubleJay 2011-07-25T05:49:07Z 2011-08-22T17:38:06Z <p>Many of the methods of physics are vastly more general than their use in that discipline. For example, information theory overlaps with a lot of statistical mechanics, and the latter actually developed first. ET Jaynes wrote a famous paper illustrating the connections. However, each is comprehensible without the language and intuition of the other (though I do not deny that a richer understanding comes from knowing both). </p> <p>What other methods of physics (particularly those with a statistical or computational bent) have interpretations (Please mention useful introductory texts!) that are completely physics free? I understand that various field theories meet this criterion; any good non-physics introductions?</p> http://mathoverflow.net/questions/67989/optimizing-directly-on-the-eigenspectrum-of-a-matrix Optimizing directly on the eigenspectrum of a matrix DoubleJay 2011-06-16T19:01:14Z 2011-06-16T21:42:25Z <p>I have an application where I want to the eigenvalues of the graph to be involved in the objective and constraints in a flexible way (moreso than just the nuclear or frobenius norm). Whats a good survey or intro source to this sort of optimization?</p> http://mathoverflow.net/questions/32533/is-all-non-convex-optimization-heuristic Is all non-convex optimization heuristic? DoubleJay 2010-07-19T20:42:50Z 2011-06-05T15:54:05Z <p>Convex Optimization is a mathematically rigorous and well-studied field. In linear programming a whole host of tractable methods give your global optimums in lightning fast times. Quadratic programming is almost as easy, and there's a good deal of semi-definite, second-order cone and even integer programming methods that can do quite well on a lot of problems.</p> <p>Non-convex optimization (and particularly weird formulations of certain integer programming and combinatorial optimization problems), however, are generally heuristics like "ant colony optimization". Essentially all generalizable non-convex optimization algorithms I've come across are some (often clever, but still) combination of gradient descent and genetic algorithms.</p> <p>I can understand why this is - in non-convex surfaces local information is a lot less useful - but I would figure that there would at least be an algorithm that provably learns for a broad class of functions whether local features indicate a nearby global optimum or not. Also, perhaps, general theories of whether and how you can project a non-convex surface into higher dimensions to make it convex or almost convex.</p> <p>Edit: An example. A polynomial of known degree k only needs k + 1 samples to reconstruct - does this also give you the minimum within a given range for free, or do you still need to search for it manually? For any more general class of functions, does "ability to reconstruct" carry over at all to "ability to find global optima"?</p> http://mathoverflow.net/questions/66150/what-function-smoothly-interpolates-between-the-identity-and-exponential-or-log What function smoothly interpolates between the identity and exponential (or log and identity) functions? DoubleJay 2011-05-27T02:58:39Z 2011-05-27T06:22:22Z <p>Or rather, what function can be parametrized with some value t in [0,1] such that f(x, t= 0) = x, f(x, t = 1) = e^x, and f(x, 0 &lt; t &lt; 1) is a principled interpolation between those two, kind of like the gamma function is a principled interpolation for the discrete factorial.</p> <p>Obviously, many functions fit the bill, like f(x,t) = x^(1 + t*(x/ln(x)-1) ), but that seems kind of arbitrary.</p> <p>What mathematically useful/elegant function exists?</p> http://mathoverflow.net/questions/63496/what-can-be-said-about-an-infinite-linear-chain-of-conjugate-prior-distributions What can be said about an infinite linear chain of conjugate prior distributions? DoubleJay 2011-04-30T03:59:32Z 2011-05-17T06:46:23Z <p>We can sample a discrete value from the multinomial distribution.</p> <p>We can also sample the parameters of the multinomial distribution from its conjugate prior the dirichlet distribution.</p> <p>Since the dirichlet distribution is part of the exponential family, it too must have a conjugate prior distribution in the exponential family.</p> <p>I hope you see where I'm going: what happens as this chain of priors is taken to infinity? </p> <p>For a simpler example, what happens with the self-conjugate Gaussian distribution?</p> http://mathoverflow.net/questions/52785/best-practices-for-learning-mathematics-especially-in-the-classroom Best Practices for Learning Mathematics (especially in the classroom) DoubleJay 2011-01-21T19:14:09Z 2011-01-21T21:38:20Z <p>I am an undergraduate CS major with strong interests in applied math and theoretical computer science. In the past, I've done reasonably well grade-wise in all math-related (that is, pure math, applied or theoretical CS) classes, but I feel that I still haven't taken away as much as i could have from most.</p> <p>As people who have often taught math courses and had to deal with the inevitable fact that no lecture will be universally effective, what are your suggestions for how I (as a student) can best learn in these classes.</p> <p>A few problems I've experienced regularly:</p> <p>When professors try to present long and difficult proofs on the blackboard. I always find it ridiculously hard to understand proofs in real time or to understand verbal and visual explication of the proof simultaneously. I have to look the proof up in a textbook, and the comprehensibility of textbook proofs varies widely. </p> <p>More generally, accessing the "kernel" of the proof that really makes it comprehensible is sometimes difficult, especially when it's presented more formally. I tend to think of proofs in terms of algorithms, and proofs that don't fit this well tend often evade me.</p> <p>Definitions, even, (especially in pure math) tend to blend together and become obscure. I've re-learned the basic definitions of probability waaaay too many times. </p> http://mathoverflow.net/questions/33033/how-much-reading-do-you-do-before-you-attack-a-problem How much reading do you do before you attack a problem? DoubleJay 2010-07-23T01:21:38Z 2010-07-23T16:13:48Z <p>When going off on a tangent from your regular area, where, presumably, you have such mastery of all cutting-edge research from your routine reading that you hardly need to do any extra (if this is false, please correct me), how much do you try to familiarize yourself with that area before beginning to directly attack your problem? Do you read just a few canonical papers and surveys, look thoroughly over a dozen and glance at a couple dozen more, or do enough to write a whole survey article of your own?</p> http://mathoverflow.net/questions/32345/compressed-sensing-with-an-unusual-basis Compressed Sensing with an Unusual Basis DoubleJay 2010-07-18T07:33:37Z 2010-07-20T16:26:37Z <p>I'm wondering if compressed sensing can be applied to a problem I have in the way I describe, and also whether it should be applied to this problem (or whether it's simply the wrong tool).</p> <p>I have a large network and plenty of data on each node. I want to find a set of communities that explain most data similarity and track these communities over time. In a compressed sensing formulation this amounts to the following:</p> <p>-My graph's representation basis is a weighted set of communities, where each community is a subset of the set of all nodes (candidate communities can be narrowed down to a tractable number rather easily)</p> <p>-Different feature measures (e.g. bigrams, topic profiles) serve as my sensing basis, with correlations between community membership and features serving as the coefficients of my measurement matrix. The big assumptions, that my feature measurements have the Restricted Isometry Property, that similarity is incoherent with community, and that similarity is a linear combination of community, are all almost certainly incorrect, however they seem plausible approximations to within (possibly significant) noise.</p> <p>Ideally, I can use this strategy to describe my network as a collection of communities and to track over time the prominence of these communities. I wonder, however, if there isn't some straightforward bayesian method that I'm overlooking.</p> <p>Misc Questions about Compressed Sensing: </p> <p>i) If my measurements are not linear combinations of my representation basis, but at least convex, then can I still usefully use compressed sensing? Edit: In the above case, for instance, the generally accepted submodularity property of networks means that a node's membership in additional communities that correlate positively with a feature have reduced effect. In this particular case it might be best to transform everything to logs, but in general this option might not be viable.</p> <p>ii) What is the meaning of the dual of basis pursuit?</p> <p>iii) How does one avoid basis mismatch in general? You choose your representation basis elements beforehand, so how do you make sure they're capable of representation?</p> <p>Edit iv) If your measurements are naturally represented as vectors, rather than scalars, is there any way to represent this other than counting each component of the vector as a separate measurement (though I suppose this works fine in general, if you have enough information about each component and everything is linear).</p> http://mathoverflow.net/questions/32442/how-to-generate-a-net-on-a-8-dimensional-sphere/32519#32519 Answer by DoubleJay for How to generate a net on a 8-dimensional sphere DoubleJay 2010-07-19T17:39:56Z 2010-07-19T17:39:56Z <p>In general, for generating extra-regular but not-too-regular distributions of points (in a technical sense, "low discrepancy", meaning that the variance in the length of gaps between points is smaller than a uniform distribution), you can use a class of methods called quasi monte carlo methods. There are libraries in MATLAB.</p> <p><a href="http://en.wikipedia.org/wiki/Quasi-Monte_Carlo_method" rel="nofollow">http://en.wikipedia.org/wiki/Quasi-Monte_Carlo_method</a></p> <p><a href="http://www.mathworks.com/matlabcentral/fileexchange/17457-quasi-montecarlo-halton-sequence-generator" rel="nofollow">http://www.mathworks.com/matlabcentral/fileexchange/17457-quasi-montecarlo-halton-sequence-generator</a></p> <p>Though if you want a totally uniform set of points, these won't help you.</p> http://mathoverflow.net/questions/31397/good-sources-for-linear-algebra-for-convex-optimization-and-graph-analysis Good sources for linear algebra for convex optimization and graph analysis? DoubleJay 2010-07-11T11:17:22Z 2010-07-11T11:17:22Z <p>What are some good sources for linear algebra for convex optimization and graph analysis? In Particular, is Gilbert Strang's MIT course suitable, or some other online course? I prefer online courses (video or lecture notes) to books because they're usually much better organized.</p> <p>I'm at the undergrad level, but interested in doing research in machine learning and network theory, which use these two things respectively. I've taken one (basic, computationally-oriented: i.e. we didn't learn anything about basis, vector space or the meanings of linear mappings, but instead learned a lot about iterative methods Householder reflections) course on linear algebra, and all the time I find myself stymied by matrix formulations of optimization problems and assertions about eigenvalues of graphs.</p> <p>I want to become fluent in it for these purposes - I don't plan to go further in the pure math direction, just engineering, so keep that in mind (though a few proofs and abstractions won't kill me, and are indeed welcome.</p> <p>Side Question: Can you have a useful matrix of quaternions (since you can have complex as well as real matrices) or is that just a silly idea, for whatever reason?</p> http://mathoverflow.net/questions/25848/shortest-paths-on-fractals Shortest Paths on fractals DoubleJay 2010-05-25T05:59:46Z 2010-07-07T07:22:15Z <p>How can one find shortest paths between 2 specified points on fractals, or (since I'm pretty sure this is quite complicated) make useful generalizations about them?</p> <p>Since the above question is broad, how about this one: What is the general formulation (in a direct equation, recursive formulation, or other form) for distance between 2 points on the sierpinski carpet?</p> <p>Obviously for some fractals all points are infinite. Identifying these is often easy, but are there any edge cases where it's hard to decide whether all paths are infinite length? And if so, how does one decide?</p> <p>Edit: This question was inspired, by the way, by this thread on a different website (where it became clear that it was beyond the average math knowledge there). <a href="http://echochamber.me/viewtopic.php?f=3&amp;t=40348#p1618494" rel="nofollow">http://echochamber.me/viewtopic.php?f=3&amp;t=40348#p1618494</a> That particular post shows paths(whose presence is recursive) in the carpet.</p> http://mathoverflow.net/questions/2259/visual-representation-of-mathematical-research-interrelationships Visual representation of mathematical research interrelationships DoubleJay 2009-10-24T07:51:38Z 2010-07-07T01:32:13Z <p>I remember seeing a visualization in the form of a 2d (nodal) graph of all areas of academia, with math, physics and engineering over in one section, connecting in an arc to the central area of economics and statistics which was intermediate between it and the humanities. Psychology and sociology were in their own cluster between the humanities and econ/stats, while biology and medicine formed a huge cloud that branched towards almost everything, though it was further from the humanities than the sciences.</p> <p>I'm afraid I don't have a link, which would illustrate it much better than I can.</p> <p>Anyways, I wonder if there's something similar to this for mathematics alone, based on the specialities of co-authors, the references in research papers, common sense, etc. I'd be very interested to see what it looks like.</p> http://mathoverflow.net/questions/30538/algorithm-for-generating-a-size-k-error-correcting-code-on-n-bits Algorithm for generating a size k error-correcting code on n bits DoubleJay 2010-07-04T18:18:29Z 2010-07-04T18:51:00Z <p>I want to generate a code on n bits for k different inputs that I want to classify. The main requirement of this code is the error-correcting criteria: that the minimum pairwise distance between any two encodings of different inputs is maximized. I don't need it to be exact - approximate will do, and ease of use and speed of computational implementation is a priority too.</p> <p>In general, n will be in the hundreds, k in the dozens. </p> <p>Also, is there a reasonably tight bound on the minimum hamming distance between k different n-bit binary encodings?</p> http://mathoverflow.net/questions/27428/does-the-axiom-of-choice-or-any-other-optional-set-theory-axiom-have-real-wor Does the Axiom of Choice (or any other "optional" set theory axiom) have real-world consequences? DoubleJay 2010-06-08T04:31:05Z 2010-06-23T05:34:57Z <p>Or another way to put it: Could the axiom of choice, or any other set-theoretic axiom/formulation which we normally think of as undecidable, be somehow empirically testable? If you have a particular scheme for testing it, that's great, but even the existence or non-existence of a proof regarding potential testability is wonderful.</p> <p>How about something a little simpler: can we even test the Peano axioms? Are there experiments that can empirically verify theorems not provable by them?</p> <p>This is a slightly fuzzy question, so to clarify what I mean, consider this: the parallel postulate produces good, useful geometry, yet beyond its inapplicability to the sphere, there's evidence to suggest that the universe is actually hyperbolic - this can be considered an experimental evidence "against" the parallel postulate in our universe.</p> <p>Edit: Thanks to all the people who answered - I understand the concerns of those who don't like this questions, and I appreciate all those who answered a more modest interpretation that I should, in retrospect, have stated. That is, "Is the axiom of choice agreeable with testable theories of mathematical physics, is it completely and forever irrelevant, or is it conceivably relevant but in a way not yet known," to which I got several compelling answers indicating the former.</p> http://mathoverflow.net/questions/29056/cluster-preserving-and-distance-maximizing-embedding-into-hamming-space Cluster-preserving and distance-maximizing embedding into Hamming Space? DoubleJay 2010-06-22T07:40:50Z 2010-06-22T14:28:53Z <p>I have a set of data, each instance in the real $[0,1]^{d}$. However, it's actually all in a relatively small range around 0.5, clustered into classes in even smaller ranges. The actual origin of the data is the output of an untrained neural network, but don't worry about that.</p> <p>The distribution is correlated between variables in an unknown but not ridiculously ill-conditioned way, and I have no guarantee that the intra-cluster distance is dramatically smaller than the inter-cluster distance (it may be of the same order of magnitude).</p> <p>I would like a method for embedding into d-dimensional Hamming Space that:</p> <p>1) Preserves clusters as best as possible</p> <p>2) Maximizes inter-cluster distance</p> <p>3) Maintains relative inter-cluster distances</p> <p>4) Minimizes intra-cluster distance</p> <p>In that order.</p> <p>The obvious solution is some sort of machine learning method, but since i'm actually trying to apply this to improve a different machine learning method, I want a method that's rather quick and simple instead. What I was doing was just rounding, but that failed #2 spectacularly. Rounding based on centroids or mediods of the data instead would be a little more sophisticated, but still wouldn't do a great job of #2, #3, and sometimes #1. </p> http://mathoverflow.net/questions/28861/mathematics-of-the-anthropic-principle Mathematics of the Anthropic Principle DoubleJay 2010-06-20T16:39:44Z 2010-06-21T05:09:52Z <p>A form of the anthropic principle is as follows: "We can observe the universe only because we can exist within it in some way such that we can observe it, and it exists such that we can observe it."</p> <p>What mathematical consequence does this have? I know it's broadly a problem of Bayesian probability, and we must consider all that we see from the perspective P(A|B), A = some aspect of observed reality, B = we think, therefore we are. </p> <p>Can this be formulated in some useful and general way to answer questions about the universe, existential, cosmological or otherwise, or do the mathematics here give us little information?</p> <p>NOTE: I know that the anthropic principle is often stated in a much more specific way and looked at from the perspective of cosmology, but that's not what I'm looking for here.</p> <p>Edit: To clarify the mathematical content of this question I'll give two examples (one from a comment below). </p> <p>1) I've seen claims like "the anthropic principle indicates that we most likely live at a time such that half of all people that have ever been born have been born". I want to know if a statement like this is at all reasonable or not.</p> <p>2) Consider it in these (not entirely sufficient) terms: You have a vague outline of a set of prior distributions in addition to some error-prone observations whose errors depend on the prior distribution. How can you glean information about the prior distribution.</p> http://mathoverflow.net/questions/27055/is-perfect-play-possible-in-continuous-rock-paper-scissors-game-step-size-vs Is perfect play possible in continuous rock-paper-scissors? game "step size" vs. "acceleration" DoubleJay 2010-06-04T15:21:25Z 2010-06-04T19:22:17Z <p>The first part of my question is simple: Is every game continuous in time and strategy-space also a game of perfect information with a good equilibrium? For example, consider rock-paper-scissors. The discrete version has no nash equilibrium - a perfectly uniform random mixed strategy is the best option.</p> <p>Continuous rock-paper-scissors, by contrast, allows players to move at some limited velocity (consider 2 cases, acceleration is limited and acceleration is infinite) through a "strategy space" s.t. R+P+S = 1, and (0.5, 0.5, 0) vs. (0,1,0) returns 0.5 to player one and -0.5 to player 2, while (1,0,0) returns 1 to player one, -1 to player 2. To avoid the "go directly to the middle" strategy, it's fine to remove (1/3,1/3,1/3) or some disk around it from the strategy plane.</p> <p>So, is continuous RPS effectively a game of perfect information?</p> <p>For a more dramatic example, consider the stock market as a game. If it were continuous, would randomness essentially be removed? Would a player also need to explicitly know the strategies of all other players as individuals, or only the end result of those strategies (i.e. value of stocks at a given point in time) in order to play perfectly?</p> <p>For a more realistic example, consider a hunt between a dog and hare. Strategies for them are the direction they choose to run in the pursuit. The dog has reflexes r, the time it takes him to notice the hare's change in direction. The rabbit has acceleration a. Ignore the dog's acceleration for now. As r*a becomes extremely small (i.e. the dog's reflexes are swift relative to the hare's acceleration), does this effectively converge to a continuous, perfect-information game (specifically the game of the homicidal chaffeur), or is the difference still important? Specifically, suppose that the dog can only make decisions on pursuit directions at increments equal to r - I don't want it to be a continuous game with a lagging signal.</p> http://mathoverflow.net/questions/25629/learning-statistical-mechanics-for-non-particle-phenomena Learning statistical mechanics for non-particle phenomena DoubleJay 2010-05-23T06:54:17Z 2010-05-23T14:31:07Z <p>I'm interested in various areas of complex systems, and I often come across articles like these: </p> <p><a href="http://arxiv.org/PS_cache/cond-mat/pdf/0106/0106096v1.pdf" rel="nofollow">http://arxiv.org/PS_cache/cond-mat/pdf/0106/0106096v1.pdf</a></p> <p><a href="http://arxiv.org/abs/cond-mat/9804180" rel="nofollow">http://arxiv.org/abs/cond-mat/9804180</a></p> <p>The main points are accessible in each (much less so the 2nd one though), but I'd like to be able to understand this sort of writing deeply, or even be able to do it myself.</p> <p>What sort of studies would I need to undertake? Would a standard thermal/statistical physics class do it, or do I need something more drastic? Are there any resources along the lines "statistical physics for the social scientist" that are still rigorous and high-level?</p> <p>(There's a question about "statistical physics for the mathematician", but this is almost exactly the opposite of what I need, funnily enough"). </p> http://mathoverflow.net/questions/25630/major-mathematical-advances-past-age-fifty/25636#25636 Answer by DoubleJay for Major mathematical advances past age fifty DoubleJay 2010-05-23T07:51:28Z 2010-05-23T07:51:28Z <p>Christos Papadimitriou is in his late 50's now (I can't find his exact age, which is a little strange), and in just the past few years he's done major work in algorithmic game theory, a field at least somewhat removed from the one he made his career in. Technically, he's a theoretical computer scientist - I say this is close enough though.</p> http://mathoverflow.net/questions/13750/what-are-the-applications-of-hypergraphs Comment by DoubleJay DoubleJay 2012-04-11T00:49:07Z 2012-04-11T00:49:07Z Do np-complete problems include the stable polyamorous marriage problem? http://mathoverflow.net/questions/79010/l1-regularized-least-squares-on-a-matrix-with-toeplitz-blocks-not-block-toeplitz Comment by DoubleJay DoubleJay 2011-10-24T23:05:31Z 2011-10-24T23:05:31Z You're right, it's kn x n, or some small factor difference depending on how I deal with edge effects. I'm using iterative methods, like Iterative Shrinkage and Thresholding, and I've found a paper that uses a greedy method. None of this takes advantage of the Toeplitz structure except through the relative efficiency of applying the convolution. I'll take a look at that link, thanks. http://mathoverflow.net/questions/71188/probabilistic-and-other-mathematical-methods-of-physics-without-the-physics/71377#71377 Comment by DoubleJay DoubleJay 2011-07-29T16:47:01Z 2011-07-29T16:47:01Z This is interesting because I originally learned about Quaternions solely in their context as an interesting mathematical construct, a non-commutative algebra of historical interest. http://mathoverflow.net/questions/66150/what-function-smoothly-interpolates-between-the-identity-and-exponential-or-log/66158#66158 Comment by DoubleJay DoubleJay 2011-05-27T15:49:57Z 2011-05-27T15:49:57Z This is a neat answer. In its current form it is waaaay too complicated for my application, but the idea of using power series approximation is a good one. Thanks! http://mathoverflow.net/questions/66150/what-function-smoothly-interpolates-between-the-identity-and-exponential-or-log Comment by DoubleJay DoubleJay 2011-05-27T03:47:03Z 2011-05-27T03:47:03Z Unfortunately, that will probably have to be determined empirically. The application, however, is interpolating between additive units and multiplicative units for a neural network. Igor's suggestion has the virtue of simplicity, and would probably work well for a sparse vector of ts, actually. Upvoting it. http://mathoverflow.net/questions/66150/what-function-smoothly-interpolates-between-the-identity-and-exponential-or-log Comment by DoubleJay DoubleJay 2011-05-27T03:19:10Z 2011-05-27T03:19:10Z To be quite honest, any easonable-looking function that's smooth and differentiable will suit my purposes. I want to interpolate between additive and multiplicative weights for a machine learning application. http://mathoverflow.net/questions/66150/what-function-smoothly-interpolates-between-the-identity-and-exponential-or-log Comment by DoubleJay DoubleJay 2011-05-27T03:11:42Z 2011-05-27T03:11:42Z I don't expect there to be just one, but perhaps there is a particular one that is particularly useful. The Gamma function is not the only function interpolating between factorials, but it is by far the most used, and in many senses that &quot;natural&quot; one. http://mathoverflow.net/questions/52785/best-practices-for-learning-mathematics-especially-in-the-classroom/52795#52795 Comment by DoubleJay DoubleJay 2011-01-22T02:11:06Z 2011-01-22T02:11:06Z Even though this topic was closed, this answer is exactly what I was looking for. Thanks! http://mathoverflow.net/questions/52785/best-practices-for-learning-mathematics-especially-in-the-classroom Comment by DoubleJay DoubleJay 2011-01-21T20:53:37Z 2011-01-21T20:53:37Z I would disagree that it's off-topic. Many topics here are professors asking how they should teach; why not a student asking how he should learn? http://mathoverflow.net/questions/33033/how-much-reading-do-you-do-before-you-attack-a-problem Comment by DoubleJay DoubleJay 2010-07-23T16:29:43Z 2010-07-23T16:29:43Z The drift of the responses so far is a lot more &quot;dive in head first, then read while you work&quot; than I expected. That's actually really nice to know - I've been reading myself to death on a problem, and still feeling like I'm missing out on a vast amount of important facts. You guys have inspired me to get my hands dirty! http://mathoverflow.net/questions/32533/is-all-non-convex-optimization-heuristic/32634#32634 Comment by DoubleJay DoubleJay 2010-07-20T14:15:55Z 2010-07-20T14:15:55Z I glanced at the course you mentioned, and it seems very interesting. Can you tell me in what circumstances these techniques are competitive with heuristics like particle swarm optimization for applications? http://mathoverflow.net/questions/32588/n-widths-and-kolmogorovs-entropy Comment by DoubleJay DoubleJay 2010-07-20T04:38:30Z 2010-07-20T04:38:30Z Nvm the edit - it's null. http://mathoverflow.net/questions/32533/is-all-non-convex-optimization-heuristic Comment by DoubleJay DoubleJay 2010-07-19T21:16:43Z 2010-07-19T21:16:43Z Yes, or if we can't do that, then can we at least make it easier to iterate through local minima, to smooth our surface in a productive way, or guarantee bounds on how densely we need to sample from the search space? http://mathoverflow.net/questions/32533/is-all-non-convex-optimization-heuristic Comment by DoubleJay DoubleJay 2010-07-19T20:53:07Z 2010-07-19T20:53:07Z Alright, I changed a couple things - these changes actually do make the question more clear, so thanks for suggesting that. http://mathoverflow.net/questions/32527/measures-of-the-complexity-of-a-metric Comment by DoubleJay DoubleJay 2010-07-19T19:47:19Z 2010-07-19T19:47:19Z You might want to look into something called discrete differential geometry, used mainly for computer graphics. It doesn't provide a formula, but it could help you measure your surface. In general, something like bregman divergence from a sphere would be good, I think. (Though I don't know exactly how you'd measure it).